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PERSONAL HISTORY CORRELATES OF PHYSICAL 
SCIENTISTS’ CAREER ASPIRATIONS 


LEWIS E 


{merican 


In discussing the problems of managing a 
research and development laboratory, several 
writers (Bello, 1956; Miles & Vail, 1960; 
Torpey, 1960) have mentioned the trend to- 
ward providing two ladders of advancement 
for the physical scientist employed in large 
One of these lines of 
progression is the supervisory or adminis- 
trative route within the laboratory. The other 
consists of “bench” research positions of in- 
creasing complexity or responsibility, but re- 
quiring little or no administrative supervision 
of others. This latter hierarchy is intended to 
provide comparable ‘‘rewards” to productive 
researchers without diverting their efforts into 
administration. The rewards course, 
larger salaries, more rank, impressive titles, 
and privileges similar to supervisory and man- 
agerial “extras.” 

Implicit in this modified organizational 
structure is the suggestion of basic differences, 


industrial laboratories. 


are, of 


at least in career values and aspirations, be- 
tween research scientists and administrative 
personnel. Common educational backgrounds, 
identical treatment during recruitment, and 
initial laboratory employment would tend to 
mask such differences, however, and these 
could be critical in subsequent performance. 
If differences do exist, then selection and 
placement techniques should be capable of 
development to assist in matching scientists 
and laboratory career choice 

One technique which has shown promise in 
a similar area—engineering job placement— 
is the Strong Vocational Interest Blank. Spe- 

1 The writers wish to acknowledge the assistance 
of Wallace J. Smith of the Standard Oil Company 


(Indiana) and William A. Owens of Purdue Uni- 


versity in the conduct of this study 


ALBRIGHT anv J. R 


GLENNON ! 


Oil Company 


cifically, Dunnette (1957) found that scoring 
keys derived from the Strong discriminated 
among engineers working in different functions 
(pure research, sales, etc.). More recently, 
Kulberg and Owens (1960) showed that a 
number of life history items were differentially 
correlated with Dunnette’s keys, which is not 
surprising since many “life history” items 
have to do with interests. But this finding 
does suggest that a personal history question- 
naire itself might prove to be a valid dis- 
criminator of supervisory- vs. research-ori- 
ented scientists. The present study is an 
attempt to investigate that possibility 


METHOD 


the pe rsonal history ques 
procedures of data collec- 
tion and analysis used in this study may be found 
in an earlier report (Smith, Albright, Glennon, & 
Owens, 1961). Briefly, a 484-item instrument cover 
ing various background topics was administered to 
employed petroleum scientists ; 
sponses analyzed ross-validated 
three criteria of job (supervisory 
made separately on both over-all job performance 
and creativity, as well 
number of patent 
period). 

For the purpose of the present study, the 
were grouped according to their 
first two alternatives of Question 17° 
sonal history questionnaire, which follows 


A detailed description of 


tionnaire, subjects, and 


research Item _ fre 
against 


ratings 


were and < 


success 


as the objective criterion of 


disclosures filed during 5-year 
ubject 


responses to 


179. Assuming a free choice which line of progr 
sion would you prefer? 


1. Research assignments, such as, research as 
sistant, research associate, etc 

Supervisory or administrative assignments 
such as, group leader, section leader, et« 
Advancement outside the Research Depart 
ment 


Anv of the above 
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Initially, only those individuals were considered 
who had not yet achieved positions high enough to 
be in either of the lines of advancement described in 
Responses 1 and 2 above. Therefore, these subjects 
were termed research and administrative aspirants, 
respectively. There were 79 of the former and 62 of 
the latter. The groups were equated for length of 
company service by eliminating 11 of the longer 
service research aspirants, resulting in the total 
complement of both groups having hiring dates after 
World War II. The groups, as then constituted, were 
compared with respect to their amount of education, 
ratings on job performance and creativity, and num- 
ber of patent disclosures. 

Following these comparisons, each group was sub- 
divided into random halves and item analyses of the 
remaining 483 personal history items performed on 
each combination of research and administrative sub- 
samples separately. Items were retained which dis- 
criminated the administrative from the research as- 
pirants in both item analyses at the .10 level or 
beyond; on a compound probability basis this is 
equivalent to approximately the .05 level or less. 


RESULTS 


Comparability of aspirant groups on educa- 
tion and criterion variables. Inspection of data 
on the educational attainment of the research 
and administrative aspirants revealed no es- 
sential difference between the groups on this 
variable. Inasmuch as the subjects were volun- 
teers from the finite population of the labora- 
tory, the ¢ test proposed by Johnson (1949, 
p. 71) was used to test the significance of the 
difference between means of the groups’ per- 
formance and creativity ratings, as given in 
Table 1. The results show that the administra- 
tive aspirants were rated significantly higher 
than the research aspirants on both over-all 


2 Because the performance ratings were based on 
a seven-step forced distribution system with 1 as the 
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performance and creativity.2 A median test 
(Walker & Lev, 1953) revealed that the me- 
dian difference of six patent disclosures in 
favor of the research aspirants, also shown in 
Table 1, was significant. (The variation in Ns 
appearing in Table 1 is due to missing cri- 
terion data.) 

Personal history analysis. The item analyses 
of the personal history questionnaire against 
the research-administrative dichotomy estab- 
lished from Item 179 revealed a total of 43 
items which discriminated the aspirant groups 
at the required significance level. For illus- 
trative purposes, three of these are given be- 
low, the “A” and “R” designating the group, 
administrative or research, making the indi- 
cated response more frequently than the other 
group. 


133. How much time, on the average, do you spend 
reading technical or professional journals, 
magazines or books? 


1. None 
2. Less than 1 hour a week 
1 to 3 hours a week 
. 4 to 7 hours a week 
. More than 7 hours a week 


. Would 
which: 


your choice of an ideal job be one 


1. Allowed a great amount of interaction with 
other people 

2. Would require working with a small group 

3. Would allow you to work closely with on: 
other person 


4. Would allow you to work by yourself 


Assuming you had sufficient musical ability 

and training to perform in the following ca- 
highest rating and 7 the lowest, the larger mean of 
4.47 for research aspirants is in fact a poorer rating 


TABLE 1 


COMPARISONS OF RESEARCH ANI 


Variable ‘search Aspirants 


VW SD 


Over-all Performance Rati 
Creativity Rating 
No. of Patent Disclosures 


* These values are medians, others are 


+¢ tests for significance of difference b 


\DMINISTRATIVE ASPIRANTS ON 
RATINGS AND PATENT DIscLosurRE Ret 


PERFORMANCE AND CREATIVITY 


IRDS 


Adminis tive Aspirants 


Significance 


VW SD 


$.03 8 
24.85 78. 


1.006 10.02 


1? 
2 
4 


/ 





Scientists’ Career Aspirations 


pacities, which one do you believe would give 
you the greatest personal satisfaction 
1. Soloist—instrumental or vocal 
R. 2. Composer 
4. 3. Conductor 
Arranger 
Member of or 
not soloist 
6. Critic 
Although many of the significant items are 
more concerned with factual biographical in- 
formation than are these three, there is a sur- 
prising confirmation of the stereotype of the 
research scientist as a somewhat introverted, 
work-oriented person vs. the more outgoing 
status seeking, administrator. 


VALIDITY GENERALIZATIONS 


It is necessary, for prediction purposes, to 
verify these findings on independent samples 
because of the “internal” method of item 
validation used. Consequently, the records of 
65 individuals not involved in the previous 
analyses were selected for study. Fifty-three 
of these subjects were either group leaders or 
section leaders, the remaining 12 being re- 
h associates or their Refer- 
to Question 179 shows that their job 
titles placed these subjects in one of the two 
lines of advancement mentioned in Responses 
1 and 2 and hence, are called administrative 
and research incumbents, respectively, in the 
remainder of this paper. Any incumbent not 
indicating a preference, on Question 179, for 
the line of advancement in which his job title 
placed him was held out for separate analysis. 

Examination of the three criterion variables 
incumbent that the 
trends noted earlier for the aspirants remained 
the same, i.e., administrators were rated higher 
on performance and creativity but had fewer 
patent disclosures than the researchers. (Sig- 
nificance tests were not employed in this case 
because of limited data on one or more cri- 
teria.) 

The validity of the 43 previously significant 
personal history items was investigated for the 
incumbents by use of a simple scoring scheme. 
Each incumbent, regardless of actual job title, 
was arbitrarily given a score of + 1 for every 
characteristic of the research as- 
pirants and a — 1 for an administrative type 


sear assistants. 


ence 


for the groups showed 


response 


TABLE 2 


SCORES OF RESEARCH AND ADMINISTRATIVE 
INCUMBENTS ON 43-ITEM PERSONAI 
History Key 
Research 
Incumbents 
y 


XX 

XXXX 
XXXXXXXXX 
XXXXXXXXXXX 
XXXXXXXXXX 
XXXXXX 
XXXXXX 


response. Table 2 shows the distribution of 
total scores on this scoring key. The means of 
6.42 for researchers and — 1.72 for adminis- 
trators are in the expected direction and differ 
significantly (¢ = 5.32 with 63 df, p< .01). 

An additional bit of evidence of the validity 
of the key was obtained by applying the scor- 
ing system to the papers of six administrative 
incumbents whose responses to Question 179 
indicated they preferred the research line of 
advancement. Their mean score of 
roughly midway between those of the other 
two groups, makes sense intuitively since these 
individuals see themselves 
their present jobs. 

A second validity generalization study was 
carried out with individuals one or more levels 
higher in the organization than those utilized 
heretofore. Specifically, the personal history 
questionnaires were scored of five senior re 
search division directors 
These jobs are virtually the highest ones in 
the research and administrative hierarchies, re- 
spectively. (Obviously, the pyramidal shape of 
the organization seriously limits the number 
of such positions.) The responses of these 
groups were available on only 18 of the 43 
discriminating items, but the means of .80 for 
the researchers and — 1.50 for the adminis- 
trators follow the pattern previously estab- 


> 97 
IO, 


as misplaced on 


associates and 12 
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lished. The small numbers of subjects pre- 
clude the meaningful application of any 
statistical test of significance; it would seem, 
however, that in confirming the trend, this 
finding is more than merely suggestive. 


DISCUSSION 


The process of applying a scoring key de- 
veloped at one level of the organization to 
successively higher echelons for validity gen- 
eralization purposes is somewhat novel in the 
writers’ experience. It seems reasonable to 
believe, however, that differences in personal 
history which can be discriminated at the 
entry level should persist as people move up, 
although such differences will be increasingly 
difficult to demonstrate due to smaller Ns, 
greater remoteness of early experience for the 
older person, etc. How fruitful the method 
would prove in closely allied measurement 
areas such as interest and personality test de- 
velopment is questionable. With relatively 
homogeneous groups it would seem to offer 
real promise. But among managers in general, 
for example, the work of Porter and Ghiselli 
(1957), using a self-description adjective 
checklist, suggests that differences between 
management levels might mask within-level 
differences. 

Besides their importance in job placement, 
significant personal history differences be- 
tween industrial researchers and their ad- 
ministrator colleagues could have implications 
for other features of the laboratory climate. 
For example, it is the administrators who, by 
nature of their jobs, determine the perform- 
ance ratings, salary adjustments, promotional 
prospects, and the like. They or their sub- 
ordinates do much of the college recruiting. 
In short, one’s own 


biases toward favoring 


kind, consciously or unconsciously practiced, 


could do a great deal of harm to the organi- 
zational careers of research scientists and, of 
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course, serious disservice to the research 


achievements of the laboratory. 


SUMMARY 


A total of 43 personal history items were 
found to differentiate employed petroleum re- 
search scientists desiring to advance in the 
laboratory supervisory hierarchy from a simi- 
lar group aspiring to increased salary and 
status while remaining “at the bench.” For 
purposes of validity generalization a scoring 
key composed of the discriminating items was 
applied successively to groups of scientists 
working at the middle and upper levels in the 
administrative and technical lines of advance- 
ment. The key retained its discriminating 
power (though to a lesser extent) at each 
higher echelon of the laboratory organization. 
Some implications of this result for personnel 
placement and management of an industrial 
research and development function were dis- 
cussed. 
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SIMPLE FORMULA AIDS FOR UNDERSTANDING 
THE JOINT ACTION OF TWO PREDICTORS! 


MELVIN R. MARKS 


Psychol Research Associates, Arlington, Virginia 


RAYMOND E. CHRISTAL, ann ROBERT A. BOTTENBERG 


Personnel Laboratory, Wright Air Devel 


»pment Division 


Suppose you had the problem of predicting 


academic success in a college course. You try 
two predictors in a large sample and find that 
one has a validity of .10 and the other has a 

determine 


99 ith 


validity of .00. Furthermore, you 
that these two predictors correlate 
each other. What would you conclude? 

If your conclusion is that you should throw 
away the two predictors and start over again, 
in its 
you are not 


read this article 


If, on the other hand, 


then we suggest you 
entirety 
surprised to learn that these two predictors 


will produce a multiple correlation of .707, 
then you might wish to skip to the formula 
derivations in the last section of this article. 

It all 
multiple R of .544 for two predictors was com- 


started when, in actual research, a 
puted. Now there is nothing unusual about a 
multiple correlation validity coefficient of .544, 
except in this case the validity coefficients for 
168, re- 


were 


the two predictors were .060 and 


spectively. At first, the results ques- 


tioned—especially when it was noted that the 
correlation between 


the two predictors was 
979. ° 


The investigator was familiar with so 
lled ‘‘suppressor effects,” 
occasion to see them in action to this extent 
He found himself checking the results on a 
calculator. A mistake had not been made 
When the finding was discussed with 


ca but he had not had 


asso- 


The 


statisticians took the attitude of “I told you 


clates, their reactions were interesting 


The research reported n this paper iS sponsore 
in part by Personnel Laboratory, Wr 
ment Division, under ARDC, Project 

" The authors have some doubts about 
normal explanation of The fac 
torial explanation breaks down rapidly as the number of 
predictors increases beyond two, and is not completely 
adequate when there are only two predictors. For 
example, in the problem “from actual research” men 
tioned in this paper, V; is an aptitude composite and V» 
is the square of that same composite. It is difficult to 
explain | vhat in this 


instance 


ey ve lop 


the term and 


“suppressor effects 


what is being suppressed out of 


so,” for they had been warning researchers 


against forecasting multiple correlations from 
The att 


tude of most investigators, on the other hand, 
I 


inspection of the predictor matrix 


was one of “Well, I'll be damned.” They 
realized they would not have predicted these 


Tact, 


experime nta 


results from inspection of the data 
if they had come 
variables 


across two 


with such a high intercorrelation, 
they would have discarded one without hesita- 
tion—especially if neither predictor had mu 
relationship with the criterion. 

We thought the 


perhaps 


reader might enjoy, and 


profit from some 


experiences Lhe 
authors had while studying the effect of the 
intercorrelation term on. the two-predictor 

Before con 


us adopt the following notation 


multiple correlation 


tinuing, let 


validity coethcient of Predictor 1 
validity coefficient of Predictor 2 
correlation between Predictor 1 
Predictor 2 

multiple correlation 

he first and primary point is that for any 


fixed pair of validity coefficients, there must 


be a value for the intercorrelation term which 
vill produce a minimum, multiple correlatio: 


coefficient. Applying a little to the 


calculus 
basic two-predictor formula, the authors were 
pleasantly surprised to find that this value 
turns out to be simply the ratio of the two 


validity coefficients. That is 


value of the intercorrelation term for a 
fixed pair of validity coefficients in the 
two-predictor equation which results 
in a minimum R. Select the ratio which 


results in a value of 1.00 or less 
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Stated in other words, for the three-variable 
case, when the correlation between predictors 
is identical to the ratio of the predictor validity 
coefficients (smallest coefficient in the numera- 
tor), the multiple R is a minimum. Any value 
of the intercorrelation different from this ratio 
will yield a larger multiple R. 

What is the value of this minimum R? With 
a little thought it becomes obvious that the 
minimum R always will be exactly equal to the 
larger of the two validity coefficients. In other 
words, the ratio of the two validity coefficients 
will locate for us an intercorrelation value 
such that the variable having the lowest valid- 
ity will add nothing to the variable having the 
highest validity in predicting the criterion. 
Thus, when the intercorrelation is equal to the 
ratio of the validity coefficients, there is no 
increase in predictive efficiency by employing 
the variable with the lowest validity. 

Since the ratio V;/V» seems to be all-im- 
portant for the effect of the intercorrelation 
on the magnitude of multiple R, it will be of 
interest to examine the results for the cases 
where V, Vo, where V; # Vo (neither V;, 
nor V and where V; or V2 (but not 
both) is equal to zero. Note that the first and 
third 


is zero), 
cases are spet ial, in that they rarely 
occur. 

In the first case, where V, Vo, the ratio 
Vi/Ve is exactly 1.00. If two validity coeffi- 
¢ients are equal, then, the smallest multiple 
will be obtained the two 
predictors are perfectly related. Any other 
value for the intercorrelation term will result 
in a higher multiple R 

“So what?” one might ask. Most of us have 
been taught that, in general, the lower the 


correlation when 


relationship between two predictors, the higher 
the resulting multiple. Perhaps the best answer 
is provided by a look at Case 3, where V; or V2 
(but not both) is equal to zero. In this instance 
Vi/V_ is .00, and the lowest multiple R will 


be computed when the two predictors corre- 


late zero. Thus, the mirror image of Case 1 
exists, and it can be shown (see Table 1) that 
the higher the correlation of the predictors, the 
higher will be the resulting multiple R. 

Both Case 1 and Case 3 are special cases. 
The more usual situation is Case 2, where 
V,; ~ V2 and neither is zero. For example, let 
us assume that V, is .50 and V» is .10. In this 
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instance, V»2/V, is .20. If the correlation of 
Predictor 1 with Predictor 2 were .20, then 
Predictor 2 would add nothing to Predictor 1, 
and the resulting multiple R would be exactly 
50. If the correlation of Predictor 1 with 
Predictor 2 were different from .20, in either 
direction, the resulting R would be greater 
than .50. 

This simple formula could be especially 
helpful to investigators who lack ready access 
to computing facilities. Suppose, for example, 
one had a matrix containing the intercorrela- 
tions and validities for an operational selection 
composite and certain experimental variables. 
He could simply take the ratio of each of the 
experimental variables, in turn, to the validity 
coefficient of the selection composite. By com- 
paring these ratios to the observed intercorrela- 
tion he could determine if any the 
experimental variables could add _ predictive 
variance to the selection composite. The greater 
the discrepancy between the ratio and the 
intercorrelation, the greater would be the 
expected contribution of the experimental 
variable to the composite. It should also be 
noted that situations may where 
might make greater progress toward improving 
prediction by increasing the correlation be- 
tween predictors (validities being held con- 
stant) rather than decreasing such correlations. 

A formula to determine the values for the 
correlation between two predictors which will 
lead to a maximum R turns out to be very 
simple: 


one of 


exist one 


the correlation between 
(with fixed validity 
which will grant multiple 


two values for 
two predictors 
coefficients) 
R of 1.00. 


From applying this formula, we see that, when 
two predictors have validity coefficients of .50 
and .10, respectively, they will produce a 
multiple correlation of 1.00 if their correlation 
with each other is either .91 or —.81. 

A little more understanding of the influence 
of the correlation between two predictors on 
the resulting R can be obtained by inspecting 
Table 1. This table shows the fallacy of the 
widely accepted opinion that in order to get a 
high multiple correlation we should have a 





Formula Aids for Use 


with Two Predictors 


‘ABLE 1 


I: FFECT OF THE CORRELATION 


Fixed Pair 


Fie ee ee ee ee 
Ss = = eee NN NN 


J 


r for minimum R 
r#ifor R = 1.00 
r#2forR 1.00 


high correlation between eac! of the indepen- 


dent variables and the dependent variable, 
and a low correlation between the predictor 
variables. That this viewpoint is not 
sarily correct was demonstrated very clearly 
by Horst (undated). Although Table 1 illus- 
trates the manner in which the R changes as 
the predictor intercorrelation varies for a few 
formulas 


neces- 


selected pairs of validities, and the 


BETWEEN Two PREDICTORS ON THI 
CORRELATION COEFFICIENT FOR FIXED VALIDITIES V 


MAGNITUDE OF THE MULT 


AND | 


of Valid 


ady 


presented above provide a re answer to the 
question of the values of r which minimize and 
maximize R ina two-pre dictor « ase, the reader 
should recognize that the only sure way of 
determining the extent to which a predictor 
will increase t} 
predictors is to compute the multiple correla- 


1e predic tive efficienc V of a set of 


tion both with and without the predictor in 
question. 
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FORMULA DERIVATIONS 


1. To solve for the value of r which mini- 
mizes R for a fixed pair, V; and V2, differen- 
tiate the following expression with respect to 
ry; then set the derivative equal to zero and 
solve the resulting equation for r. 


— 2ViWVr + 21 
(i-r 
Setting the derivative equal to zero and multi- 
plying through by —(1 — 7 


> we obtain: 


2V Vr +2(V7+) ¢+ 2V,} 0 


Solving for the roots of the equation, we obtain: 


— 16(} 


2. To obtain values of 
multiple R of 1.00 when 
fixed 


r which provide a 


two predic tors with 


validity coefficients are least-squares 
1] 
ai 


weighted, solve the following equation for r: 


therefore, solving for r: 


2ViVert V4V 2V: 


) 


and simplifying : 


r=V\V2tV(1—V2e1-—V2) [2 


Restriction 1: When V, V's, only one root 
of Formula 2 is applicable and it reduces to 
the expression 2V? — 1. 

Restriction 2: Formula 2 is not applicable 
when |, V2 Q. This is the only fixed pair 
of validity coefficients for which no value of r 
will grant a multiple R of 1.00. 


SUMMARY 


It was demonstrated that the ratio of any 
two fixed validity coefficients will locate a 
value for the intercorrelation term in the two- 
predictor, multiple correlation formula such 
that the variable having the lower validity will 
contribute nothing to the variable having the 
higher validity. The resulting multiple corre- 
lation is thereby a minimum. 

A second de- 
termines two intercorrelation values for any 
fixed pair of coefficients which will 
result in a multiple correlation of 1.00. This 
second formula hold both 
validity coefficients are exactly zero, and is 
restricted 


formula is presented that 


validity 


does not when 


to determination of a single inter 


correlation value when the two validity coeffi- 


cients are exactly equal and not zero. 
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A FACTOR ANALYSIS OF JOB ACTIVITIES’ 


Georce J. Parmer, J+ 


Louisiana State University 


Over a period of years considerable prog- 
ress has been made in the identification of 
the nature of different human abilities and 
characteristics. In the area of mental abilities, 
for example, the classic work of Thurstone 
(1947) is, of course, generally considered a 
milestone. In the domain of motor skills, 
some of the studies by Fleishman (1960) 
have helped to crystallize the nature of these 
human dimensions. 

While human attributes have 
become somewhat clarified, there has been 
relatively little effort given to the identifica- 
tion of what might be thought of as the 
dimensions of jobs. Viewing human work and 
its many variations, it is reasonable to be- 
lieve that there might be certain basic di- 
mensions of work activity which conceivably 
could be identified and described 


some thus 


A few stud- 
ies have tended to confirm this hypothesis 
Coombs 
Bes- 
and 


Among such studies are those by 
and Satter (1949), Hemphill (1959), 
nard (1954), and McCormick, Finn, 
Scheips (1957). 

In approaching the domain of human work, 
however, one could take at least two different 
points of view. First, one could consider the 
description of work primarily in terms of 
job characteristics. Such descriptions might 
emphasize the technological aspects of jobs, 
or they might emphasize what workers ac- 
complish in their jobs (such as baking, sell- 
ing, painting, and so forth). Descriptions in 
terms of technology or in terms of accom- 
plishments might be thought of as “job ori- 
ented” descriptions of the work activities of 
people. On the other hand, one could view 
terms of what workers do 
in performing their jobs, e.g., visual, manual, 
or communications activities. These might be 
thought of as “worker oriented” descriptions 
of what the worker does, i.e., how he uses 
the technological factors to achieve 
ends. 


human work in 


certain 


1This study was supported by funds from the 


Purdue Research Foundation 


Ernest J. McCormick 


Purdue University 


The distinction between the “job ori- 
ented” and “worker oriented” approaches is 
not always clear cut; it is largely a matter 
of emphasis. In general, perhaps the differ- 
ences can be summarized by saying that the 
“job oriented” view is likely to place more 
emphasis on the conditions and results of 
work, while the ‘worker oriented” view tends 
to place more emphasis on worker activities 
as such. 

This study was one that was viewed as a 
“preliminary” effort in this 
direction. In particular, it was the plan to 
develop a check list of job activities of a 
“worker oriented’ nature, to 
describing a sample of jobs 
the results to factor analysis to attempt to 
identify the worker activity “dimensions” of 
In this 
effort it was realized that the experimental 
check list of work activities that might be de- 
veloped would be only something of a 


and “probing” 


use these in 


and to subject 


the jobs in question. exploratory 


“first 
approximation” of what might ultimately be- 
come a more precise device. It was further 
realized that, with what would be a restricted 
the 
would have to be viewed in the light of the 


sample of jobs resulting ‘dimensions 
sample of jobs in question and, therefore 
would not necessarily have general applicabil- 
ity. In other this pri 
marily as a methodological study to find out 
if it might be profitable to explore this rela- 
tively virgin 


words, was viewed 


territory 


PROCEDURI 
Check List 


check list 


worker 


Job Activities 


A 177-item 
terms of 
lines 


cribing job activities ir 


behaviors, was organized generalh 


along suggested by information theory no 
and 
and brief descrip 
Most of 


Irom 


illustrated 


tions, such as input, decision 


The major parts of the 


storage, output 
check list 
tion of their contents are presented below 
the examples given are the identifying 
items that were more fully defined 
in the check list proper 


stems 


and 


1. Information-Receiving 
tive to the 


Activities items rela 


use of senses to obtain information 


RO 
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carry out work activities—for example, identifies or 
distinguishes sounds by pitch or tone) 

2. Mental Activities (43 relative to: de- 
cision making activities; various kinds of 
knowledge, including general and specific vocational 
educational development—for example, evaluates 
performance of people) 


items 
uses of 


3. Supervisory and Communications Activities (33 
relative to: responsibility for supervision; 
oral, written, and signal communications; interper- 
sonal contacts involved in these activities—for ex- 
ample, supervises work group) 

4. Manual Activities (25 items relative to: use 
of hands to operate controls, vehicles, 
equipment; direct use of hands to modify materials 
—for example, operates keyboard device, i.e., type- 
writer) 


items 


tools, or 


5. General Bodily Activities (24 items relating to: 
use of the whole body in simple or coordinated 
movements—for example, climbs) 

6. General Work Conditions 
conditions in the physical 
example, noise level) 


(7 items relating to: 
work environment—for 
7. General Job Characteristics (10 items relating 
to: ratings of the job as a whole on general worker 
ittributes—for example, adaptability to routine) 


Sample of Jobs 


A job sample was selected to represent the job 
structure of a large producing firm. Of an 
estimated 10,000 jobs in the company, job descrip- 
tions were available for about 5,000, from which the 
sample of 2 


steel 


250 was selected. 

The composition of the sample was as follows: 
Exempt salaried jobs (operating, administrative, 
technical, and related jobs), 40%, were described 
in terms of purpose, function, skills, knowledge, and 
responsibility. Nonexempt clerical jobs, 10%, were 
described in terms of tasks and time distribution. 
Hourly paid jobs (steel production and processing, 
maintenance, inspection, and related 50%, 
were described concisely in terms of functions, edu- 
cation, supervision, and other conditions, as given 
by the Cooperative Wage Bureau 
industry jobs. 

It should be noted that the objects of study were 
jobs, not personnel, nor positions (personnel-in- 
jobs). The jobs were not sampled in proportion to 
numbers of incumbents, so that the 
cannot be interpreted in terms of 
employed personnel 


jobs), 


1953) for steel 


present results 
importance for 


Analysis of Jobs 


Data and Method. The basic information about 
the jobs in the sample was contained in written 
job descriptions. Each job in the sample was 
analyzed on the basis of the information in its 
descriptions, in terms of the item of the check list. 
One of the investigators analyzed each job by read- 
ing its description, indicating on the check list the 


George J. Palmer, Jr. and Ernest J. McCormick 


presence or degree of each job activity which he 
considered to be pertinent to the jcb in question 

Reliability of Analysis. The reliability of analysis 
was estimated from the degree of agreement be- 
tween competent analysts for a sample of 
Eight graduate students in industrial psychology 
made independent analyses of 2 to 5 jobs apiece, 
and their analyses were compared with those of the 
investigator. The index of agreement for dichotomous 
items was the coefficient of overlap, Peters and Van 
Voorhis (1940), Formula 61. For continuously 
scored items, the index was the Pearson product- 
moment correlation 

Reliability data were based on 130 
the total list. Some items 
they were seldom or never checked. Thirty-two 
items were eliminated because the overlap co 
efficient was indeterminate, a result of a 
nominator. 


32 jobs 


items from 
were eliminated because 


zero de- 
The median coefficient of agreement was .75 and 
only 7% 41, indicating a reasonably 
satisfactory degree of argument among the analysts 
in selecting the check list items which 
sidered to be pertinent to each job. 


were below 


they con 


Methods of Data Analysis 


The check list data for the sample jobs were 
correlated and subjected to factor analyses in two 
stages. 

Initial Factor Analyses. The first factor analyse 
were based on the correlations of check list vari- 
ables within each of five groups of variables. These 
groups consisted essentially of the items in Sections 
1 through 5 of the check list. Items were scored 
dichotomously and intercorrelated with an 
index developed specifically for check list data by 
Ben J. Winer, Purdue University.* Items which were 
checked less than 15 times were not included in 
the analysis, so that the final matrices for Sections 
1 through 5 contained from 21 to 31 items. Each 
matrix was factored separately by the multiple 
group method as given by Thurstone (1947). The 
highest coefficients in the columns or rows of each 
group were used as communality estimates 

Factor Scores. For purposes of estimating the 
factors, simple integral weights ranging from — 3 
to +3 were assigned to items according to the sign 
and magnitude of their factor loadings. For each 
factor variable, each job’s score was the algebra 
sum of weighted items checked for it. It would 
have been possible to develop a complete multiple 
regression equation to estimate each factor, but as 


were 


2 For a 2 X 2 table, alb/cld, where a is the 


cell and letters are cell frequencies, this index is 


1/2(b+c 


\V ~awtbte 


This coefficient takes the sign of the difference insice 
the absolute value bars. It may be noted, too, that 
ignores Cell d and gives equal weight to b and c 





Factor Analysis 


Guilford (1954), for one, points out, the gains are 
small for the labor. 

Final Factor Analysis. For purposes of integrating 
the factors obtained from parts of the check list, 
a sixth factor analysis was carried out. Factor scores 
which had been developed for the 24 factors re- 
sulting from the factor analyses of Sections 1 
through 5 were intercorrelated (using Pearson prod- 
uct-moment correlations) together with 14 
not hitherto included for analysis. Some of these 
14 items were surviving items from Sections 6 and 

concerning General Work Conditions and Gen- 
eral Job Characteristics; also included were several 
items relating to educational development which 
had been reserved for inclusion in this final analysis 

A 28 X 28 correlation matrix was factored by the 
method of principal components programed for the 
Datatron computer. The highest correlations were 
used as trial communalities in a first factoring and, 
upon identification of the chief factors, re-estimated 
communalities were used in a second analysis. The 
decision to stop factoring was based on the rate of 
reduction of the residuals and rotation to orthogonal 
simple structure was effected by the graphic single 
plane method. Jobs were given scores on the rotated, 
final factors variables by the weighting procedure 
previously described 


RESULTS 
Results of Initial Factor Analyses 


The five initial factor analyses resulted 
in 14 separate oblique group “factors.” These 
factors were typically bipolar, because to 
some extent job activities had this mutually 
exclusive character, and partly because of the 
way items were defined. 

In interpreting the factors, it should be 
noted that the basic data were descriptive 
of jobs, and that the resulting factors were 
characterized by combinations of coexistent 
activities. The basic data are perhaps best 
considered to be occupational (or perhaps 
organizational) in nature, rather than psycho- 
logical. The factors, then, consisted of those 
activities which tended to “hang together’”’ 
in jobs. Thus, it might be that two or more 
distinctly different “types” of activity might 

A seven-page table containing items of highest 
loading and sample jobs for the multiple group 
factors has been deposited with the American Docu- 
mentation Institute. Order Document No. 6738 
from ADI Auxiliary Publications Project. Photo- 
duplication Service, Library of Congress; Washing 
ton 25, D. C., remitting in advance $1.25 for micro- 
film or $1.25 for photocopies. Make checks payable 
to: Chief, Photoduplication Service, Library of 
Congress 


of Job Activities 


items 
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be common to the same factor because of the 
fact that these activities typically occurred 
together in jobs. This point is emphasized be- 
cause factors from such data would not be 
expected to have the same kind of “psycho- 
logical” sense that would be true of relation- 
ships among measures of human test per- 
formance. 

The interpretation of the factors is indi- 
cated by the descriptive titles which are in- 
tended to summarize the general pattern of 
factor loadings. The multiple group factors 
are listed below according to the section of 
the check list from which they were derived. 
To illustrate each factor, sample jobs which 
typify jobs with high and low scores (in that 
order) on the factor are given in parentheses 

Information-Receiving Activities Factor 
1: Visual Information from Physical Objects 
vs. Displays (Scrap Inspector vs 
writer ) 

Factor 2: Tactual Information 
from Objects (Welder vs. Fireman) 

Mental Activities.’ Factor 3: Routine vs. 
Administrative Decision Making (Car 
Checker vs. Farm Manager) 

Factor 4: Supervisory and Professional De- 
cisions vs. Physical Activity (General Fore 
man vs. Operator, Tube Rolling) 


Copy- 


Visual vs. 


Routine vs. Business Planning 
Decisions (Hydrostatic Tester vs. Supervisor 


of Commercial Markets) 


Factor 53: 


Supervisory and Communications Activt- 
ties.® Factor 6: Routine Verbal Communica- 
tions vs. Signals or Managerial Contacts 
(Personnel Clerk vs. Medical Director) 

Factor 7: Communications Given Verbally 
vs. Via Signals (Head Timekeeper vs. Ambu- 
lance Driver) 

Factor 8: Communications from 
vs. Personal Contacts (Craneman vs 
Specialist ) 


Signals 
Market 


Factor 9: Originating vs. Receiving Com- 
munications (Superintendent of Foundry vs. 
Clock Repairman) 


*For information purposes, the correlation 
tween the group factors was ris= .35 

5 The correlations among the group factors 
ta — — 30, re = 52, to = — 30 


6 The correlations among the group factors 


were 


27, ve 55 fn= 12, r2 — .64, 


Var 4d, Vos 


feo = 
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TABLE 1 


Factor LOApINGS 


Variable Loading 

Factor I General Decision Making and Mental Activity 

Reasoning 

Language 

Decision Making vs. Physical Activity 

Originating vs. Receiving Communications 

Latitude of Job Activities 

Mathematics 


Communications Given Verba vs. via Signals 


FACTOR SCORE LEVEI SAMPLE Jos 
High Medical Director 
Average Salesman 


Low . Bricklaye 


entary vs. Physical Work Activity 
Sedentary vs. Physical Activity 
Visual Information from Physical Objects vs. Displays 
Routine vs. Business Planning Decisions 
Manual Operations 


General Physical Activities vs. Postural Restrictions 


FACTOR SCORE LEVE! SAMPLE Ji 
High Interviewer 
Average Guard 
Low Hooker, (¢ 


Factor III: Communications in Business Management vs. I 
Work 
Originating vs. Receiving Communications 
Communications from Signals vs. Personal Contact 
Routine Verbal Communications vs. Signals or Manag 
Routine vs. Administrative Decision Making 
Routine vs. Business Planning Decisions 


Visual Information from Physical Object 


FACTOR Score LEVEI SAMPI 
High Superintendent 
Average Clerk Typist 


Low Mechanica 


Factor I\ Knowledge of Tools vs. Mathematics 
Use of Craftsman’s Tools vs. Other Hand Implements 
Use of Body of Knowledge 
Routine vs. Administrative Decision Making 
General Physical Activities vs. Postural Restrictions 


Mathematics 


Factor Score Lev! SAMPLE Jos 


High Instructor, Carpenter Apprentice 
Average Mill Shearman 
Low Payroll Clerk 





Factor Analysis of Job Activities 


Manual Activities.’ Factor 10: Manual 
Operations (Operator, Tube Rolling vs. Head 
Timekeeper ) 

Factor 11: Use of Craftsman’s Tools vs. 
Other Hand Implements (Millwright vs. Re- 
search Technician ) 

General Bodily Activities. Factor 12: Gen- 
eral Physical Activities vs. Postural Restric- 
tions (Helper, Axle-Maker vs. Safety In- 
spector) 

Factor 13: Sedentary vs. Physical Activity 
(Supervisor vs. Operator, Oiling Machine) 

Factor 14: Bodily 
Activities Hooker, 
Crane) 


Manual vs. General 
(Time Study Man vs 


Results of Final Factor Analysis 


In the final factor analysis, a principal 
components analysis extracted four factors 
which may be considered higher-order (al- 
though not second-order) factors; all were 
based in part on factors derived from the 
initial factor analyses, and in part on the 
14 new variables introduced in this final 
analysis. The bipolar nature of some of these 
final resulted from conditions: 
first, from the positive and negative loadings 
from the bi- 
polar nature of the multiple group factors 
correlated with the final Principal 
(orthogonally rotated) loading and sample 
jobs are given for each final factor, in de- 


factors two 


of the variables, and, second, 


factors. 


scending order of importance (see Table 1) 

Factor I accounts for 66% of the variance 
a general factor. Factors II, III, and 
IV account for 15 to 8% of the variance 
Factor I indicated that the greatest differ- 
ences between jobs lie in Decision Making 
Mental Activities. Factor II indicates 
differences in physical activity. Factor [II 
various and methods of 
communications for originating, relaying, or 
receiving job information. Factor IV suggests 
knowledge or skill in the use of mathematics, 
perhaps relating to manual and computa- 
tional routines. The mathematical aspect of 
Factor IV is, of course, independent of Fac- 


and is 


and 


refers to sources 


7 The correlation between the factors was 


11 00 


group 


8 The correlations among the group factors were 
11, fw 14 34, m2 14 23 
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tor I on which mathematics also has a high 
loading. 

The emergence of Factor I, with its em- 
phasis on decision making and mental activi- 
ties as the most dominant factor, seems to 
be in keeping with the results of a number 
of job evaluation studies which have sug- 
gested that the most important performance 
influencing the evaluation of jobs are those 
associated with mental requirements, skill, 
experience, and related variables (Tiffin & 
McCormick, 1958). Designation of this fac- 
tor in terms of decision making activities 
gives it an interpretation consistent with the 
organization theorists. such as 
Simon (1948), who hold that, on the vertical 
dimension of organizations, the main differ 
ence between jobs is related to the level of 
decision making 


views of 


Limitations 


On the whole, the 
large number of 


results show 


job activities for a 


that a 
rather 
wide range of jobs can be organized mean- 
ingfully in terms of a small number of inde- 
pendent dimensions. However, the results 
should be interpreted with certain limitations 
in mind. 

First, it should be that the check 
list of worker oriented activities was viewed 
as a “first approximation” toward the de- 
velopment of what might ultimately be a 
much more refined device. Further, the sam- 
ple of jobs was clearly a very limited one 
the sample consisting of jobs from only one 
industry. It should be pointed out that the 
job descriptions varied in length, detail, and 
format, depending upon the class of jobs ir 
question and, also, that the check list was 
used with the job descriptions (the secondary 
source), rather than with direct observation 
of the jobs themselves 


noted 


CONCLUSIONS 


This study was carried out as something 
of a “probing” project to test the feasibility 
of identifying what might be thought of as 
the “dimensions” of worker activities of 
jobs. Specifically, factor analyses of five sec- 
tions of the worker activities check list pro- 
duced 14 multiple-group factors. A subse- 
quent factor analysis of the jobs in terms 
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of their scores on these 14 factors and 14 
other selected variables produced four more 
general factors, as follows: General Decision 
Making and Mental Activity, a general fac- 
tor; Sedentary versus Physical Work Activ- 
ity; Communications in Business Manage- 
ment versus Information in Routine Physical 
Work; and Knowledge of Tools versus 
Mathematics. 

In examining the original 14 factors and 
the four final factors, a number of them 
seem to make a reasonable amount of “logi- 
cal” sense. Certain of the factors, however, 
seem to be rather distinctly influenced by 
what apparently were fairly unique facets of 
some of the jobs in the particular sample 
in question. 

It may be concluded that the results tend 
to support the view that work activities can 
be identified or measured and that the variety 
of human work activities may be organized 
with greater simplicity and economy in terms 
of a smaller number of relatively independ- 
ent dimensions. 

REFERENCES 
Besnarp, G. G 


senior B-29 
Res. Cent 


Shred-outs of tasks performed by 
mechanics. USAF Train. 
tech. Rep., 1954, 


Personnel 


No. 54-4 


George J. Palmer, Jr. and Ernest J. McCormick 


Coomss, C. H., & Satter, G. A. A factorial ap 
proach to job families. Psychometrika, 1949, 14, 
33-42. 

Cooperative Wace Bureau. Job description and 
classification manual for hourly-rated production, 
maintenance, and nonconfidential clerical jobs 
Pittsburgh: CWB, 1953. 

FLEISHMAN, E. A. The description and prediction 
of perceptual-motor skill learning. Presented at 
Symposium on Training Research and Its Impli 
cations for Education, University of Pittsburgh, 
February 1-3, 1960. 

Guitrorp, J. P. Psychometri: 
McGraw-Hill, 1954 

HEMPHILL, J. K. Dimensions of executive positions 
A study of the basic characteristics of the po 
sitions of ninety-three business executives. Edu 
Test. Serv. res. Bull., 1959, No. 59-5 

McCormick, E. J., Fixx, R. H., & Scnetps, C. P 
Patterns of job requirements. J. appl. Psychol., 
1957, 41, 358-364 

Peters, C. C., & Van Voornis, W. R. Statist 
procedure and their mathematical base New 
York: McGraw-Hill, 194 

Srmon, H. A. 
Macmillan, 


methods. New Yor 


Administrative behavior. New York 
1949 
Tuurstone, L. L. Multiple factor analysi 
Chicago Press, 194 

& McCormick, E. J 


Cliffs, N. J 


Univer 
Trrrin, J., 


cago 
Industrial psy- 
Prentice-Hall 


cholog y Englewood 


1958 


Received August 31, 1960) 





| of Applied Psycholog 
\ N 5, 295 


45 


USE OF ANALYTICAL INFORMATION CONCERNING 
TASK REQUIREMENTS TO INCREASE THE 
EFFECTIVENESS OF SKILL TRAINING* 


JAMES F. PARKER, JR 


al Research Associate 


’svcnologt 


The design of training programs for com- 
plex skills customarily involves a combina- 
tion of expert judgment and known principles 
of learning. Often these programs are highly 
successful. However, to any psychologist in- 


volved with practical training problems, the 
gap between learning principles developed 
in the laboratory and the application of these 
to training practice becomes painfully ap- 
parent (DuBois & Manning, 1957; Gagné 
& Bolles, 1959; McGehee, 1958). There are 
many reasons for this including a lack of 
knowledge of the manner in which principles 
of learning are related to particular char- 
acteristics of the tasks learned. Furthermore, 
laboratory studies of learning frequently are 
concerned with treatment variables which 
are apt to have only a small practical effect 
in training situations relative to the large 
individual difference variables 
abilities) (DuBois, 1960; Fleishman & 
Hempel, 1955). The problems of task dimen- 
sions and ability differences are not unre- 
lated and can be handled in the same con- 
ceptual framework. For example, tasks can 
be described in terms of the abilities re- 
quired to perform them (Fleishman, 1960). 

[he present evaluates a training 
program in which use was made of analyti- 
cal information about ability requirements 
of the task to be learned. Two types of 
analytical information were used. The first 
involved knowledge about the more general 
abilities (e.g., spatial orientation) which con- 
tribute to performance on the task in ques- 
tion. The second information con- 
cerns the relative contribution of the 
different specific task components (e.g., 


effects of 


(e.g., 


report 


type of 
con- 


‘This study was under Contract 
Nonr-2489(00) between Psychological Research As- 
sociates and the Office of Naval Research. A more 
detailed account can be found in the original report 
by the same title prepared for ONR 


performed 


EDWIN A. FLEISHMAN 
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trol stick or pedal movements) to over-all 
task proficiency. In this latter case one can 
ask if the specific ability to use the pedals 
at a given stage of training is highly related 
to learning rate and to final proficiency; if 
so, can this information be used effectively 
in training? In applying information about 
both kinds of task components (general 
abilities and specific intratask relationships), 
special attention was given to their contribu- 
tions to individual differences at different 
stages of training on the task in question 

We will proceed in the following order: 
We will describe the task to be learned, how 
the analytical information was obtained, the 
training program developed, and the evalua- 
tion of the program 


THe TRAINING TASK 


Display-Control Characteristics 


The task to be learned a complex 
tracking task, described in detail in previous 
reports (Parker & Fleishman, 1959, 1960) 
A device was constructed so as to simulate 
roughly the display characteristics and con- 
trol requirements of an interceptor aircraft 
The subject envisioned himself to be flying 
the attack phase of an airborne radar inter- 
cept mission. His task was to keep a target 
dot in the center of an oscillograph display 
while at the same time trying to keep a 
pointer centered on an instrument dial, desig- 
nated a “sideslip indicator.’”’ The controls 
used by the subject involved a standard air- 
craft control system of stick and rudder ped- 
als. These were coupled in a manner similar 
to those of an actual aircraft. Thus, if the 
target dot on the scope was to the right 
the subject made appropriate control move- 
ments to steer the “craft” to the right. These 
movements would bring him “on target” 
and the target dot would return to the center 


was 
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As in an aircraft, all 
such turning movements required coordi- 
nated action of stick and rudder controls. 
Thus, application of right control pressure 
without the proper amount of right rudder 
produced a sideslip to the left and a conse- 
quent left deflection on the “sideslip indi- 
cator.” This indicator provided the subject 
with additional information regarding the 
“degree of coordination” he was achieving 
in centering the dot. The target course was 
programed through an analog computer. The 
control stick was an acceleration control; 
that is, the extent of the subject’s stick move- 
ment was directly related to the acceleration 
of dot displacement. The rudder pedals ap- 
proximated a pure velocity control. The task 
was a very difficult one for subjects to mas- 
ter. Photographs of the device may be found 
elsewhere (Parker & Fleishman, 1959, 1960). 


of the scope display. 


Performance Scores 


The following five performance measures 
obtained during each testing 
Four of these were error 
a time-on-target score. The error scores rep- 
resent the extent of target dot (or indicator 
displacement summated through 


were session. 


scores; one was 


needle ) 
time. 
Integrated absolute 
recorded at the conclusion of every trial and 
was produced by summing algebraically the 


error score. This was 


three absolute error part scores described in 
accordance with this relationship: 


T=1/2X +1/2¥+Z [1] 


Integrated absolute error score 
X = Absolute azimuth error 

Y = Absolute elevation error 

Z = Sideslip error 


where: T 


Each of the following 
corded every third trial. An automatic se- 
quencing mechanism switched from one part 
score to the next at the conclusion of each 
trial. 

Azimuth (yaw) part summation 
of the total error occurring in the horizontal 
axis of the oscillograph display 

Elevation (pitch) part score. A summation 
of the total error occurring in the vertical 
axis of the display 


part scores was re- 


score. A 


James F. Parker, Jr. and Edwin 


A. Fleishman 


measure of 
between stick and 


Sideslip error part score. A 
the lack of coordination 
rudder movements 

Time-on-target score. The time during the 
trial when the target dot and the sideslip 
indicator needle were both (simultaneously ) 
within prescribed tolerance limits 


ANALYSIS OF TRACKING 
PERFORMANCE 


THE 


We now turn to the analysis made of the 
component task requirements for this par- 
ticular tracking task. The rationale and de- 
tails of this analysis have been reported else- 
where (Parker & Fleishman, 1959, 1960). We 
will summarize this briefly and then describe 
the application of this analysis to the ex- 
perimental training program. 


Derivation of Ability Requirements 


The approach here was an extension of a 
series of studies by Fleishman (1957, 1960) 
Fleishman and Fruchter (1960), Fleishman 
and Hempel (1954, 1955), and Parker and 
Fleishman (1959 These studies use 
the fact of individual differences to probe into 
the ability task. Thess 
studies have demonstrated that in learning 
a complex task the particular abilities con- 
tributing to proficiency may change system 
atically at different stages of practice. This 


1960). 


requirements of a 


suggests the possibility that a more efficient 
method of training might take into account 
this changing pattern of abilities. 
Information the changing abil 
tracking task ce 


regarding 
ity requirements of the 


scribed above was obtained in a previous 


study (Parker & Fleishman, 1959). A com- 
prehensive battery of 44 reference tests of 
known factorial administered 
to 203 subjects who also mastered the track- 
ing task. There tracking 
each consisting of 21 one-minute trials. The 
intercorrelations among the reference tests 
were factor analyzed. The tracking perform- 
ance scores (integrated absolute error meas- 
ure ) 


structure was 


were 17 sessions 


at 10 selected stages of practice next 
were projected onto the rotated axes defined 
by the reference battery, using Mosier’s ex- 
tension method (Fruchter, 1954). This pro- 
vided the each tracking 


factor loadings of 
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Fic. 1. Changes occurring in the 
two ability factors with inc: 


tracking 


importance 


eased practice 


practice stage, and indicated the amount of 
variance in tracking at that prac- 
tice which could be accounted each 
ability factor. 

Although 15 factors in 
the reference battery, only two, Spatial Ori- 
entation and Multilimb Coordination, con- 
tributed significant variance of a systematic 


Stage ot 


for by 


were identified 


nature to tracking performance 

Figure 1 presents the contribution of these 
through the 
It that after Practice 
3,°> there is a decrease the 
of Spatial Orientation to tracking proficiency. 
On the other hand, the Multilimb Coordina- 
tion factor in to 
session nine. We will return to the use made 


two factors training program. 


can be seen Session 


in contribution 


increases importance up 
of this information in the subsequent experi- 
mental training program 

Contribution of Subtask 


Determining — the 


Components 
\s 


ponent performances (azimuth error, eleva- 


described above, measures of com- 


Spatial Orienta 
Speed Arm 
V. Reaction Time 
Response 
IX Perceptual 
ntegration. XII. Pur 
Mechanical Experi 
and XV. Multilimb 


The identified were: I 
tion, II. Control Precision, III 
Movement, IV. Manual Dexterity 
VI. Verbal Comprehension, VII 
tion, VIII. Arm-Hand Steadiness, 
Speed, X. Visualization, XI 
Doublet, XIII 


Finger Dexterity 


factors 


ol 


Orienta 


Confusion 
ence, XIV 
Coordination 

The 17 practice 
51 time segments in provide better defi 
nition of the learning The of Fig 
ure 1 shows the relation of practice session to time 
segment and to the 10 time segments selected for use 
in the data analyses 


suit 


sessions were subdivided into 


order to 


curves abscissa 
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tion error, and sideslip error) were obtained 
along with measures of over-all performance 
(integrated error and time-on-target) during 
the course of practice. In a complex task 
such components are related to and form a 
part of over-all proficiency, although these 
precise relationships are seldom known. Fo. 
the present task the correlations among all 
these component scores with each other and 
with the over-all proficiency measures were 
obtained for 10 different stages of practice 
(Parker & Fleishman, Of particular 
interest for the present study are the correla- 


1959) 


tions of each component score, recorded at 
each of final 
proficiency recorded in the last 
practice (fiftieth time segment *). These cor 
relations appear in Table 1 

It can be seen that how well 
in the component performance 
rudder, et the early 
not 


ficiency 


stage practice, with over 


stage 0 


a person C 
(using 
in of le 


Stages 


is very final 


(It 


profi ienc\ ( 


predictive ol over-a 


might be mentioned that 


over-all lid not predict 


final 


level either However is practice continue 
all increased 


with the best predict 
“sideslip” score during later 


prediction from components 


ions obtained from the 


practice sessions 


Since this component score reflected the ex- 


ind stick coordinatiot 


tent of rudder pedal 


we have further confirmation of the factor 


il cre 
Multilimb Coordi 


analysis results, which indicated ar 


ist 
in the contribution of the 


nation factor 


On the assumption that knowledge ot 


relative contribution of component 


pertorn 


ances can provide guidance for. training 


information was used in the 


exper ime 


training program to be described next 


Error Score 
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Azimut 
Elevation 


Sideslip 


Note 





IQR 


THe EXPERIMENTAL TRAINING STUDY 

Three groups of subjects were compared. Groups 
I and II are regarded as control groups and Group 
III is the experimental group. These groups differed 
only in the nature of the verbal instructions ad- 
ministered during the course of practice 

All groups were drawn irom the same popula- 
tion: freshmen Air Force ROTC students at the 
University of Maryland. All students volun- 
teers and were paid for their participation in the 
testing program. The training period was identical 
for both control groups and the experimental group: 
17 sessions, distributed over 6 weeks, with each 

ssion consisting of 21 one-minute trials in track- 
ing 

Group I—no formal training. The first control 
group (N=203) was the group described pre- 
viously. It provided the data for the correlational 
and factor analyses of tracking performance. This 
group received no formal training on the tracking 
task other than a brief explanation of the controls, 
the display, and the task. During the entire learn- 
ing period these subjects received no instruction of 
any kind other than the questions 
They were told their trial, 
however, in order that their 
individual progress 

Group Il—‘common sense” training. The second 
group N=61) was administered a “common 
sense” type of training program constructed to be 
as much like operational military training for this 
type of task as possible. Discussions were held with 
qualified navy personnel to insure that this type of 
training was realistic in terms of present navy 
practices. This group provided a basis for de- 
termining whether the experimental training repre- 
sented an improvement over current practices when 
both were compared with Group I. This program 
involved an initial explanation and demonstration, 
guidance, and subject early 
trials, and later individual practice critiques 
following certain sessions 

Group I1l—the experimental 
that this 


were 


answering of 
following 
might 


each 


score 


they evaluate 


during 
with 


assistance to 


training. It will be 


recalled study was based upon two 


premises 


1. When it is known an ability is important 
at one point in the practice verbal 
emphasis of that ability at an earlier point in time 
will facilitate learning 

\ knowledge of the 


schedule, the 


learning of component 
within the tracking task and the inter- 
relation of these with terminal proficiency 
can be used as a means of structuring training. 

The premises were the basis of the ex- 
perimental training program for Group III (N= 
60). 


activities 
scores 


above 


As Figure 1 indicated, Spatial Orientation 
achieved maximum importance at the fourth track- 
ing session. Therefore, training instructions were 
developed to be used prior to and during the third 
session of tracking. The specific instructions were 
developed in an attempt to give insight into the 
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Spatial Orientation requirements of this task. The 
relationship between target position on the scope 
and the required direction of movement for both 
stick and rudder controls was described carefully 
The Multilimb Coordination factor starts a rapid 
rise in importance at the end of the fifth session 
and rises to maximum importance at the ninth 
session (Figure 1). Therefore, training instructions 
were developed, for administration prior to and 
during the fifth session, which emphasized the 
simultaneous use of control stick and rudder in 
controlling movement of the target dot. 

The component tracking score information pre- 
sented in Table 1 was utilized in the following 
way for Group III. Prior to and during both the 
ninth and eleventh sessions (Time Segments 25 
and 31, respectively *), instructions reemphasized 
the importance of centering the sideslip indicator 
and suggested the importance of monitoring that 
indicator rapidly and frequently while continuing 
to control the target dot on the oscillograph. 

It should be noted that the experimental program 
administered to Group III was “overlaid” on the 
“common training program which was ad- 
ministered to Group II. That is, all procedures 
used with Group II, such as initial indoctrination, 
early monitorship and guidance, and later critiques, 
were administered to Group III in conjunction with 
the experimental program. This was done in order 
to allow a direct evaluation of any improvement 
in training effectiveness as a result of the addition 
of the experimental portions 

Every effort was made to keep motivation high 
in all three groups. There 
that subjects in all three 
motivated to do their best 


sense” 


indication 
highly 


was every 


groups were 


RESULTS 


A check on the initial matching of the 
three groups indicated the groups matched 
on time-on-target (see Figure 3), azimuth 
and elevation error measures. How- 
ever, the integrated error and sideslip error 
scores indicated a slight initial superiority 
for Group III (p< .05). A check on this 
revealed this was due to an inadvertent in- 
struction given these subjects during their 
initial session to center the rudder pedals. 
Since this was such an easy operation, it was 
felt that this effect was transitory and did 
not affect the results. This assumption seems 
tenable in view of the parallel results ob- 
tained with the time-on-target score (Fig- 
ure 3), on which the groups were initially 
matched. 

Figures 2 and 3 present learning curves 
for all three groups in terms of total “inte- 
grated error” and “time-on-target” measures. 


error, 
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Comparison of integrated 
measures for Groups I, II 


In terms of each measure there is some in- 
dication of the superiority of the experi- 
mental procedures over each of the control 
procedures. Group II (common sense train- 
ing) appears substantially superior to Group 
I (no formal training). Group III (experi- 
mental training) is superior to Group II 
but the magnitude of this superiority is not 
as large as that shown by Group II over 
Group I. 

Analyses of variance (Edwards, 1951) 
were performed to determine the significance 
of this apparent effect. Since Group III is 
clearly superior to Group I, only Groups II 
and III were compared. This analysis (Table 
2) compares over-all group differences dur- 
ing the entire practice period, differences 
between practice segments. as well as the 
practice segment-group interaction. A sig- 


nificant interaction would indicate a differ- 


500 r-— 
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Fic. 3. Comparison of time-on-target measures 
Groups I, II, and III. 


ential learning rate or a different form of 
learning curve for one group compared with 
the other. 

These analyses indicate that, for both 
measures of performance, the experimental 
group is significantly superior to the control 
group. For the time-on-target scores (Table 
3) the Practice Segment X Groups interac- 
tion term is significant indicating that one 
group has either a differential rate of learn- 
ing or a different form of learning curve. This 
teraction term is not significant for the 
integrated error measure, however. 

An additional analysis was conducted to 
determine if the superiority of Group III 
could be demonstrated using only a measure 
of terminal performance. Table 4 presents 
The scores used in this analysis 
represented the average of the last nine seg- 
ments of performance for each subject. Thus, 


the results 


TABLE 2 


tLANCE 


FOR Groups II 


source 


Group II vs. Group III 
Error (Ss in groups 
Time Segments 
Segment X Group 
Interaction 

Error (Ss X segments 


within groups 5,950 


Total 6,170 


* Significant at .05 level 
** Significant at .01 level 


BASED ON INTEGRATED Error SX 


AND ITI 


Ss WS 


208,180 
3,960,754 
14,471,481 
13,701 


208,180 
33,284 
289.430 


2 +” 
/ 


3.537.650 


22,191,766 
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TABLE 3 


ANALYSIS OF VARIANCE BASED ON TIME 


Source 
Group II vs. Group III 
Error (Ss in 


grou] 


YS 
lime Segments 
Segment X Grou}; 
Interactior 

Os X seg 


within groups 


Error 


nents 


Total 


the of each individual 54 
minutes (nine segments times 6 minutes per 
segment) of tracking performance. This ex- 
panded measure was used in an attempt to 
obtain a stable index of terminal perform- 
ance for each subject. In terms of integrated 
error there is a significant indication of the 
superiority of the experimental procedures 
For the time-on-target measures the superior- 
ity of the experimental procedures approaches 
statistical significance. Inasmuch as the vari- 
of Group II II] 
heterogeneous with respect to both measures, 
the ¢ tests were run in accordance with the 
Cochran-Cox method as presented by John- 
son (1949, p. 75). This procedure takes into 
account the heterogeneity of variances. 

From the above results it appears that the 
experimental training procedures operated 
both to improve group performance and to 
decrease group variability. 


score represents 


ances and Group were 


TABLE 4 


F Tests C 


( MI 
II 


ARING 


WITH RESPECT Ti 


PROFICIENCY 


Mear 


tegrated Error (average « 
306.6 


221.1 


Group IT 
Group III 


Time-on-Target (average 
437.3 


470.3 


Group II 
Group III 


* Significant at .05 leve 


ON 


TARGET SCORES FOR GR II anp III 


UPS 


4.64" 


546.70** 


2.30** 


287,160 


2,179,209 


The analysis presented in Table 4 indi- 
cates the experimental training procedures 
to be superior in terms of resulting terminal 
proficiency. However, this conclusion is based 
primarily upon use of over-all performance 
(integrated error and time-on-target) 
ures. The integrated error measure in 
function of three component 
azimuth error, elevation error, and sideslip 
error as related in Equation I. The question 
then presents itself: Is the conclusion con- 
cerning the superiority of the experimental 
procedures dependent upon a particular com- 
ponent score? That is, are one 
the component scores producing the major 


meas 
turn 
is a scores 


or more of 
portion of the differences between the groups? 

In order to answer this question subjects’ 
each the three separate com- 
measures were examined. this 
during the final seg 
practice were summed. Table 5 
the results of ¢ tests comparing 
Groups II and III with respect to each com- 
ponent Inasmuch as the variances of 
Group II and Group III were heterogeneous 
with respect to each component score, the ¢ 
tests again were run in accordance with the 
Cochran-Cox method as presented by John- 
son (1949) 

Table 5 that for two the 
component measures (elevation and sideslip 
error) Group III is significantly superior to 
Group II. For azimuth error the difference 
approaches significance (p = .07). It appears 
then that for all component measures the 
experimental training procedures operate to 


scores of 
ponent 

purpose, 
ments 


presents 


on 
For 
scores nine 


of 


score. 


indicates of 
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TABLE 5 
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I OF Tests CompaRING Group II An 
Ill with 


RESPECT TO COMPONENT PERI 
MEASURE 


RMANCE 


Mean 


ith Error Score (average of 
up I 
up II 


691.6 591.7 


532.8 292.8 
ition Error Score 
roup II 
up III 


average Ol last! 
371.2 


192.4 


380.6 
145.9 


ip Error Score (ave 
ip Il 472.8 
up III 


IRS 3 


vari- 
ability. There is no indication that the su- 
periority of Group III, as indicated by the 
integrated error 


improve performance and to decrease 


de- 
one 
com- 


absolute measure, is 
pendent mainly upon improvement in 
particular component Each 


ponent task activity contributes to the over- 


measure 
all performance superiority of Group ITI. 


DISCUSSION 


This study investigated whether certain 
kinds of analytical information concerning 
task requirements might be used to increase 


The 


conclusion 


training 
data of this study support 


the efficiency of a program 
the 
that training procedures based upon analyti- 
cal information concerning task requirements 
can increase the effectiveness of training. 
Ambiguous results were obtained with re- 
spect to the question of a different rate (and 
possibly a different form) for the learning 
curve of the experimental versus that of the 
control group. With analysis of variance pro 
cedures the time-on-target measure indicates 
a significantly faster rate of learning for the 
experimental group. The analysis based on 
the integrated error measure did not confirm 
these results. 
lieved that the experimental training pro- 
cedures used in this study result primarily 
in an increase in the slope of the learning 
curve but not in its basic 


In general, however, it is be- 


character 
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It should be noted that no experimental 
procedures were introduced after Session 11. 
Groups II and III were handled in an identi- 
cal manner during the subsequent days rep- 
resented by the terminal proficiency meas- 
ures. In other words, last 
be regarded as trials during which transfer 
effects of the experimental procedures might 
be evaluated. The results indicate that with- 
drawal of the supplementary training instruc- 
tions did not result in a per- 
formance for the experimental group. We 
may infer, therefore, that changes in learn- 
ing occurred (with 
later performances) rather than just changes 
in performance in the presence of these ex 
perimental procedures during training 

The fact that the experimental 
procedures resulted in a _ superiority for 
Group III has certain additional implications 
It will be recalled that much of the experi- 
mental procedures were derived 
from information concerning the importance 
factors at different 
of the tracking task. The 
fact that emphasis of these abilities at ap 
the 
improvement in 
certain 
identified through 
These abilities 
more than just descriptive categories. 


these trials may 


decrease in 


consequent transfer to 


training 


training 
of underlying ability 


stages of mastery 


propriate points within 
did result in an 
would 
cerning 


training cycle 
training 
seem to bear evidence 
abilities 
analytic procedures 


con 
factor 
may be 
They 
may, in fact, represent some mediating proc 
ess within the organism 

The error 
39°% improvement in effectiveness 
at the terminal training. Yet the 
original analysis of the tracking task upon 
which the experimental training procedures 


integrated measure indicates a 
training 


Stages ol 


were based was not as fruitful as originally 
hoped. Of the 15 ability factors defined by a 
factor analysis of the battery of reference 
measures, only 2 rela 
tion to tracking performance. Therefore, only 
these 2 could be used in structuring the ex 


showed a systemat ic 


perimental training program. As further re- 
the the 
quired by tracking tasks or other tasks of 


search into nature of abilities re 
similar complexity is accomplished, it should 
be possible to establish training programs 


still more effective than used in this study 
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SUMMARY 


The objective of this study was to investi- 
gate the extent to which the effectiveness of 
training for a complex perceptual-motor ac- 
tivity might be increased through use of 
training procedures based upon a detailed 
analysis of task requirements. Specifically, a 
realistic tracking task was analyzed in terms 
of the ability factors which were important 
contributors to proficiency at different stages 
of practice and the relation of component 
task performances to terminal over-all pro- 
ficiency. 

Three groups of subjects were used. The 
three groups were trained on the same track- 
ing task and for identical periods of time. 
Group I (N = 203) received no formal train- 
ing other than the answering of questions. 
Group II (N = 60) received a “common 
training program using standard 
pedagogical techniques. Group III (N = 60), 
the experimental group, received the same 
training as Group II plus a set of standard 
instructions derived from the analysis of task 
requirements. 

The following conclusions are drawn: 


sense” 


1. There is an indication of consistent su- 
periority for the experimental procedures 
throughout the course of practice. These pro- 
cedures operate both to increase proficiency 
and to decrease within-group variability. 

2. There is no evidence that the experi- 
mental program operated differentially upon 
component task performances such as azi- 
muth error, elevation error, or “sideslip” 
error. 

3. Results indicate that the slopes of the 
learning functions differed, but this may not 
mean the basic form of the learning curve 
was different for each group. 

4. The superiority of the experimental 
group persisted in later tracking sessions, 
when the experimental instructions were no 
longer introduced. 
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J-IUS 


OPERATOR PERFORMANCE 


H. C. RATZ 


University of Saskatchewan 

The man-machine link has received con- 
siderable attention both in simple feedback 
systems (Hick, 1952) and as a data processing 
unit. In a computer system, the human oper- 
ator may be employed because of his ability 
to translate between plain language and ma- 
chine language, while in a control system his 
ability to recognize complex patterns in per- 
formance data is exploited (Elkind & Forgie, 
1959). 

The performance of an operator in choice 
ind sorting problems has been treated by 
1953). They 
to be 


several investigators (Crossman 
have found the “choice reaction time’”’ 
proportional to the stimulus complexity as 
measured by the logarithm of the number of 
alternatives. Experimental variations have in- 
cluded frequency unbalance among the alter- 
native stimuli (Hyman, 1953), and the addi- 
tion of extraneous information not relevant to 
the required choice (Archer, 1954; Gregg, 
1954). Fitts (1953) has pointed out that an 
operator’s data processing capability is sub- 
ject to the fixed constraints of his motor sys- 
tem. These constraints are implicit in the form 
of the response code and determine his effec- 
tive capacity. For example, a telegraph oper- 


itor produces time sequences with one hand, 


while the teletypist uses 10 fingers one at a 
time. The fact that motor constraints have a 

influence in the latter case is 
known from the improvements that can be 
achieved through keyboard and language stud- 
ies (Dvorak, Merric, Dealey, & Ford, 1936). 
The type of keyboard studied in this paper 
is more akin to that used by the stenotypist 
who employs several fingers simultaneously. 
At present, the typewriter remains the most 
effective man-computer communication link 
(Licklider, 1960) although other aspects of 


considerable 


the assistance 


Humphries in 
and in the 
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ON A CHORD KEYBOARD 


D. K. RITCHIE 
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computer systems such as displays and pro 
graming language have advanced 
ably. The multiple finger or “chord” keyboard 
may be a useful alternative in some specia 
purpose data processing systems. 

The relative difficulty of the various chords 
can be measured in terms of the reaction time 
in responding on the keyboard to a visual 


consider 


presentation of the chord pattern. Since lights 
fingers, and keys are in direct correspondence 
the stimulus-response codes are highly com- 
patible; that is, mental recoding of the in 
formation is Thus we 
experimental assessment of the performance 
of an operator using this chosen set of re 
sponse motor tasks. Using these data and the 
principles of optimum coding, the more fre 
quently used message units can be assigned to 
the easier response tasks. This optimum dis- 
tribution of message units will minimize the 
average time per message and maximize the 
(Blachman 


avoided obtain an 


rate of information processing 


1954). 
METHOD 
Apparatus 


A block diagram of th 
shown in Figure 1. A paper tape reader provided s« 
the lamp display. The opera 
tor responded to each pattern in turn by depressing 

{ the keyboard. A com; 
the display and respon 
was obtained from a 20-pen Ten of 
recorded the the keyboard re 
while the other 1( timing ot 
the lights. Thus reaction latency, et 
could all be obtained from the paper strip record 

The keyboard contained 10 keys mounted on 
horizontal surface and placed at the 
cupied by the fingertips with the fingers slightly 
curled and the wrists straight. The keys operated 
snap action switches through a lever which required 
about three-eighths inch travel at the key, and quit 
low pressure. These switches drove the recording pens 
and, when all keys were released, signaled the tape 
reader to present the next stimulus pattern. The lights 
used in the stimulus display placed in two 
groups of five on a horizontal line above and be 
yond the keyboard. They were mounted on a su: 
face tilted so as to be roughly perpendicular to th 
line of sight 


experimental apparatus 1 
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the corresponding keys of 
temporal record of bot! 
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Fic. 1. Block diagram of the experimental ap- 
paratus. (The flow of stimulus and response informa- 
tion is indicated. Control signals are omitted.) 


In a typical experiment, the operator depressed the 
keys on the keyboard which corresponded to the 
combination of illuminated lights presented to him. 
That is, the operator transcribed light “chords” into 
key “chords.” When all keys were released by the 
operator, a new combination of lights would appear 
whether or not the correct chord had been struck 

The function of the control apparatus was to auto- 
matically step on the tape reader and to transfer the 
combinations punched on the tape to the lamps. The 
method of operation as described above is one in 
which the operator paces himself; that is, the new 
stimulus was automatically presented after the keys 
Although 
not used in these experiments, forced pacing at vari- 
ous speeds, and with a choice of ratio of “on time” 
(stimulus presented) to “off time” 
tween stimuli), could be 
control apparatus 


were released from the previous response 


time be- 
programed with the same 


(dead 


Stimuli 

The tape reader was a standard type used with 
computers and employed five-hole tape. For experi 
ments using chords in only one hand, successive char 
acters on the tape provided. the stimulus combina- 
tions. By using a pair of characters from the tape 
for each presentation, a full 10-light pattern was 
achieved. This choice of program could be preset at 
the control apparatus. Thus when both hands were 
used the reader passed two characters of the tape at 
a time. 

Since the sequence of light patterns depended only 
on the characters of the punched tape, many experi 
ments with various sets of chords could be easily 
programed. For example, one tape employed all the 
31 different possible combinations with equal fre 


quency but in random order; another employed only 


those 15 different hand which are 
sible using either one or two fingers 


chords per pos- 


Subjects 


Six operators were used in the experiments. Three 
of these used both hands throughout, while the other 
three used only the hand of preference, which was 
the right.hand. Each operator practiced 10 minutes 
a day on random sequences of the 31 chords. The 
performance was completely recorded for the first 
and last 100 seconds of each 10-minute interval 

Although the task required in these experiments is 
a simple motor reaction, there is an initial short 
learning period. By checking the average reaction 
time of a few of the chords, it was observed that 
little improvement took place after the second day 
Asymptotic behavior was reached rather quickly b 
cause the order of the pr 
absence of any 
tween 


sentations was random. The 
intersymbol influence be 
chords precluded any longer term 
improvement through learned predictability sinc« 

this case, each of the 
likely to occu 


systematk 


successive 


possible stimuli was equalls 
at any point in the sequence. In other 
terms, the stimuli signals contained no redundancy 
so the gross data rate and the net 
tional entropy were equivalent 


rate of inforn 
Finally, because se] 
pacing was used, the number of erroneous respor 

made was negligible 


Procedure 


In order to rank the chords according to incré 
ing reaction times, a stimulus tape using all 31 
ferent chords at random was used to generate p 
terns. The daily test periods and recording intervals 
were the same as during training. From the total of 
reaction times, chord was 
signed a rank number according to its position in a 
list of increasing times. The reaction tim 
was measured between the appearance of the 
stimulus pattern and the 
corresponding chord. The 


2,660 measured each 
reaction 
lamp 
complete selection of the 
data for each chord 
totaled for the complete duration of the experiment 
since an operator’s behavior might vary 10% from 
day to day 

In the second part of the experiment, information 
rates were measured using selected groups of stimu 
lus chords. Four groups were defined which used a 
maximum of one, two, three, or all five fingers per 
hand. They appeared in random sequence with equal 
frequency. The appropriate information measure is 
the logarithm of choices 
which is the pattern of the 
source, ix 


the number of possible 
entropy per 


average 


H = loge (number of choices) 

The information rate (bits per’second) is obtained 
from the product of H and the average number of 
responses per second. The latter was measured by 
counting the total number of responses in 3-minut 
tests for the cases involving only one hand, and in 
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the right hand are indicated.) 


fingers used in 


tests for the cases with two hands. The six 


‘nt experiments are listed in Table 1 


inute 


RESULTS AND DISCUSSION 
Chord Ranking 


The average ranking of chords by increas- 
ing reaction times is shown in Figure 2, where 
the fingers used in each chord are indicated 
for the right hand. The average correlation 
coefficient among operators for all 31 chords 
is .91, hence, the agreement on the overall 
ranking is excellent. However, there is no sig- 
nificant agreement among operators concern- 
ing the rank of any chord relative to those 
immediately adjacent on the list. For exam- 
ple, if we confine our attention to the first five 
on the list, the correlation in the ranking by 
different operators is not significant; but if 
eight or more chords are taken the agree- 
ment is good. This is clear from the maxima 
and minima for the different subjects in Fig- 
ure 3. 

The main features of the chord rank chart 
are not unexpected, thus, the top five on the 
list involve only one finger each. The chords 
requiring the longest response times all con- 
tain patterns requiring one or two fingers to 
be held off while their neighbors on each side 
are used. In between (ranks 8 to 15) lie those 
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chords consisting of a consecutive group of 
fingers. 


Distribution of Response Times 


If each chord is assigned a “cost” propor- 
tional to its associated reaction time, then the 
distribution of Figure 3 is obtained. These re- 
sponse times include a 0.1-second delay in the 
presentation of the stimulus pattern. In pass- 
ing, it was observed that about 65% of the 
total time required to complete the chord re- 
sponse could be assigned to latency, where 
latency is taken as the time between stimu- 
lus presentation and the first indications of 
response. Figures 2 and 3 give the relative 
ranking of chords by response time and show 
quantitatively how the cost in reaction time is 
distributed over the different chords 

The quantitative difference in performance 
using various subgroups of chords can be pre- 
dicted from Figure 3. If it is assumed that the 
cost distribution of Figure 3 represents the 
motor response times of each chord and that 
the effect of choice when there are different 
numbers of possible alternatives is negligible, 
then the expected response time would be the 
average cost (in seconds of reaction time) de- 
termined from the distribution for the given 
subgroup of stimulus patterns. The “predicted 
response time” of Table 1 is the average of 
the costs of those chords used in a particular 
group of stimulus patterns plus the 0.1-second 


dead time between presentations. To extend 
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Fic. 3. Distribution of reaction times 
ranked according to Figure 2 


expressed relative to the median of seconds. ) 
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TABLE 1 


COMPARISON OF THE OBSERVED DATA RATE 


FOR SUBGROUPS OF CHORDS WITH THAT 


PREDICTED BY THE CH 


RANKING EXPERIMENT 


Experiment 


One Hand 
\ 
B 
( 
D 


I'wo Hands 
I 
F 


this to two hands, the distribution for all 
961 allowable 10-finger patterns would be re- 
quired. Lacking these data, the figures entered 
in parenthesis in the table are merely double 
the expected reaction times for one hand. 

Table 1 shows the results of experiments 
using only selected groups of chords and 
measuring the average response time for the 
group in each case. The “Observed Data 
Rate” is obtained by dividing the H for the 
group by the observed average response time 
T. Since H measures the stimulus information 
in binary units, the result is an information 
flow rate expressed in bits per second which 
neglects the possibility of errors. As is usual 
in this type of human operator experiment, 
the higher information rates correspond to the 
stimuli giving the greater choice and having 
higher values of H. While this conclusion is 
valid here for the cases involving one handed 
operation, note that it does not necessarily ex- 
tend to the use of two hands. Comparing Ex- 
periment A with E, and D with F, it is seen 
that an operator using only one hand may 
perform at somewhat better than twice the 
speed of one using both, and therefore having 
a greater resulting information handling ca- 
pacity. Thus the increase in choice derived 
from using both hands on 10 keys was more 
than offset by the slower response of the op- 
erator. 


Information Rates 


The agreement between the observed re- 
sponse time T and the expected average cost 
C indicates that the reaction time for a given 
subgroup of chords is very nearly the average 


of the reaction times for its individual mem- 
bers. Thus the assumption made in comput- 
ing C is substantially supported, namely, that 
the reaction times are highly characteristic of 
the individual chords and relatively independ- 
ent of the number and remaining members of 
the set. However, there is a tendency for the 
response times to be shorter (and the infor- 
mation rate higher) than that predicted when 
the amount of choice in the set becomes 
smaller; that is, the effect of the amount of 
choice on the overall response time may be 
present but is secondary to the average motor 
reaction time. Since the basis of all predic- 
tions was reaction time measurements using 
all 31 chords, the agreement in Experiment D 
is an arithmetic check. 

In Table 1, the highest data rate is ob- 
tained using all chords on one hand. How- 
ever, this assumes that the 31 different stimuli 
patterns are used with equal frequency, a 
method which is not optimum in view of the 
nonuniform cost distribution function. Obvi- 
ously, the more difficult chords should be used 
less often than the easier ones. The frequency 
distribution required for optimum perform- 
ance can be determined from coding theory. 


Application of Coding Theory 


The problem of communication with un- 
equally weighted vocabularies has been ex- 
amined as a game of strategy by Mandelbrot 
(1954). By interpreting the average response 
time to each of the chords as its cost, the code 
can be specified which will transmit a given 
amount of information in minimum time. Un- 
der the assumption that the response time to 
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a chord is independent of its: predecessors or 
the amount of choice, the encoding which 
minimizes the cost can be essentially specified 
by the relative frequencies of use of the chords 
(Blachman, 1954). Since Table 1 shows this 
assumption to be approximately true, the 
maximum information rate will be achieved 
by assigning the easier chords to the more fre- 
quent messages. 

Suppose the:chords are given a rank R = 1, 
2, . . . , 31 as shown in Figure 2 with an as- 
sociated cost (Cz) from the experimental re- 
sults of Figure 3. The problem is to find the 
relative frequency of use for each chord—its 
probability pz—that will maximize the net 
information rate H/C. Here H is the weighted 
average entropy per chord: 

H - Spr loge (pr) 
and C the average cost: 
C= SprCr 

The probabilities are normalized so that: 


=Pr 


The solution of this variational problem is 
terms of the “partition functions” of sta- 
1959); the dis- 


=F 


in 
tistical mechanics (Jaynes, 
tribution is of the form: 


Pr _ 2 as 


vhere k, the maximum information rate, is 
the solution of the equation: 
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Using Figure 3 as the description of Cr, the 
information rate obtained with optimum fre- 
quency distribution of the chords is: 


k = 4.33 bits/second 


The resulting distribution is compared in Fig- 
ure 4 with the uniform frequency method of 
Experiment D. Note that the frequency of 
occurrence of the most used chords (R = 1) 
is about 3.7 times that of the least used (R 
= 31), with the unbalance in favor of the 
easier chords. The improvement to be ex- 
pected over the results of Experiment D is of 
the order of 5% in the net information rate, 
if the frequency of use is optimum as shown 
in Figure 4. 
SUMMARY 

The 31 chords have been ranked according 
to their difficulty or “‘cost’”’ as measured by 
the reaction times, and a quantitative meas- 
ure obtained for the distribution. Assuming 
that the motor system predominates over 
choice reaction time, these results are used to 
predict the expected average response times 
and information rates using subgroups of the 
chords that involve less choice; for example, 
a group may include only a few of the easier 
chords with the shorter response times. The 
agreement with experiment indicates that the 
results were determined primarily by the re- 
action times of the particular chords in the 
group, and that the effect of the amount of 
choice was secondary. On this basis, coding 
theory can be used to deduce the distribution 
of the frequency of occurrence of chords with 
the measured cost function that gives the 
maximum information rate through the man 
machine link. 

For one hand the information rate increases 
with the complexity of choice of patterns, but 
this not remain valid for two hands 
where the loss in response speed overbalances 
the increased choice of stimuli. It should be 
noted that these keyboard experiments were 
conducted using a highly compatible display, 
and that other forms of presentation might 
introduce effects of stimulus-response coding 
that would reduce the importance of the mo- 
tor reaction time. With this qualification, the 
results show that motor system constraints are 
predominant over choice reaction time in de- 
termining speed on a chord keyboard. 


does 





H.C. Ratz and 


REFERENCES 


Identification of visual patterns as a 


exp. Psychol., 


ArcHER, E. J. 
function of information 
1954, 48, 313-317. 

BiacHMaAN, N. M. Minimum-cost encoding of infor 
mation. JRE Trans., 1954, IT-3, 139-149 

CrossMAN, E. R. F. W. Entropy and choice time: 
The effect of frequency unbalance on choice re- 
sponse. Quart. J. exp. Psychol., 1953, 5, 41-51. 

Dvorak, A., Merric, N. I., Deatey, W. L., & Forp, 
G. C. Typewriting behavior. New York: American 
Book, 1936. 

EvLKiInD, J. I., & Forcre, C 
human operator in simple manual control] systems. 
IRE Trans., 1959, AC-4, 44-55 

Fitts, P. M. The 


performance in motor tasks 


load. J. 


D. Characteristics of the 


influence of response coding on 


In, Current trends in 


D. K. Ritchie 
information theory. Pittsburgh: Univer. Pittsburgh 
Press, 1953. Pp. 47-75 

Grecc, L. W. The effect of stimulus complexity on 
discrimination responses. J. exp. Psychol., 1954, 
48, 289-297 

Hick, W. E. On the rate of gain of 
Quart. J. exp. Psychol., 1952, 4, 11-26 

Hyman, R. Stimulus information as a determinant 
of reaction time. J. exp. Psychol., 1953, 45, 188 
196 

Jaynes, E. T. A note on unique decipherability. 7RE 
Trans., 1959, IT-5, 98-102 

Lickiiper, J. C. R. Man-computer symbiosis 
Trans., 1960, HFE-1, 4-11. 

MANpELBROT, B. Simple games of strategy occurring 
in communication through natural languages. 7RF 
Trans., 1954, IT-3, 124-137. 


information 


IRE 


Received September 14, 1960) 





Journal of Applied Psycholog 
1961, Vol. 45, No. 5, 309-317 


NOISE, THE “AROUSAL HYPOTHESIS,” 
AND MONOTONOUS WORK’ 


WILLIAM N. McBAIN 


San Jose State College 


What is the nature of the relation between 
noise and performance? Over the past 45 
years there has been a discouraging lack of 
agreement among the proposed answers to 
this question. Berrien (1946) concluded that 
findings were at best “contradictory,” while 
Melton and Briggs (1960) characterized re- 
sults from the previous 2 years’ research as 
“suggestive, but not easily integrated.” In- 
deed, we have advanced little toward a gen- 
eral answer since Morgan (1916) first raised 
the question. 

The present study was undertaken in an 
attempt to clarify the problem by placing it 
in the larger framework of a theory dealing 
with the effects of environmental stimulation, 
generally. It combines the recent trend to- 
ward specifying the kind of work and of 
noise involved with a type of dimensional 
analysis of the particular classes of work 
and noise used. Though the experimentation 
is guided by these theoretical considerations, 
its focus is upon the practical problem of 
reducing errors in industrial output and of 
selecting personnel least liable to such errors. 


Noise and Arousal 


An attribute possessed noise, in com- 
mon with other stimuli, is variability. Very 
rarely, except in a laboratory situation, is an 
organism exposed to a constant, unvarying 
sound—change in stimulation is the rule. It 
has been proposed (Hebb, 1955) that 


by 


1The research reported in this paper sup 
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experimental fa- 
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changes in stimulation not only serve as 
cues to the organism, but also to activa 
or arouse areas of the cortex which are in- 
volved in the effective (or reaction 
to) such environmental cues. Marked impair- 
ments in coping behavior have been found 
(Bexton, Heron & Scott, 1954; Scott, 
ton, Heron, & 1959) when environ- 
mental 
stricted 

The theoretical relatior 
ness and the degree of arousal is not a linear 
one, but may be represented as an inverted 
U when the former variable is plotted on the 
vertical axis and the latter 


te 


use of 


Bex- 
Doane. 
stimulation has been re 


severely 


between effective- 


on the horizontal 
For a specific person, performing a particu- 
lar job, a given degree of arousal should 
lead to optimal performance, while lower o1 
higher arousal levels will be associated with 
reduced effectiveness. Since all sensory inputs 
are routed to the nonspecific arousal system, 
any environmental change, including changes 
in auditory stimulation, should result 
creased arousal. 

While the degree of arousal is chiefly a 
function of, and dependent upon, the total 
variablity of the stimulus situation, there 
seems also to be a feedback situation which 
allows higher mental processes such as prob- 
lem_ solving imagining to contribute 
Though these internal sources of arousal are 
apparently insufficient to maintain optimum 
effectiveness, our knowledge of them requires 
that they be controlled in experimentation 


in 


or 


Noise and “Intelligibility’’ 


There is a further characteristic of noise 
which, though it has little to do with either 
variability or intensity, seems to have a great 
deal to do with the extent to which a noise 
will prove distracting. “Distracting” is used 


here in the sense of successful competition 
for attention and is demonstrated when loud 
shouts in the hall spoil the rapport between 
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students and lecturer. For want of a better 
name this characteristic is referred to as “‘in- 
telligibility,” which implies that it is a joint 
function of the stimulus amd the person 
stimulated. Roughly, a noise may be consid- 
ered intelligible to the extent that it carries 
meaning within the frame of reference of the 
individual, rather than being perceived simply 
as a noise. While languages may exhibit this 
characteristic most clearly, the squeal of a 
dry bearing or the ring of a coin falling on 
pavement possess a high degree of intelligi- 
bility for appropriate auditors. 

In experimental situations one can control 
the intelligibility of the noise used by holding 
it at approximately zero (pure tones, white 
noise, etc.), or by keeping it at a low level 
which can be presumed to be approximately 
equal for all subjects. Music used in work 
situations is ordinarily restricted to instru- 
mental, and would be considered an example 
of the second approach. To the extent that 
sound is intelligible it can be presumed to be 
distracting, and hence likely to produce errors 
in the performance of a task demanding con- 
tinuous attention. 


Monotonous Work 


When applied to a work situation the two 
terms “boring” and ‘“‘monotonous”’ have fre- 
quently been used as synonyms. In this study 
the term boring will have the usual reference 
to certain unpleasant subjective states often 
associated with the performance of jobs in 
which one has no particular interest. Monoto- 
nous, on the other hand, will be reserved to 
refer to a total work situation which offers 
little variability, and hence little opportunity 
for arousal. Monotonous, when used in this 
way, is also a characteristic of the stimulus 
situation and the indvidual. The work situa- 
tion is monotonous to the extent that it lacks 
variability, which is a relatively objective and 
(at least conceptually) quantifiable charac- 
teristic. Since it is not possible to quantify 
the relatively less important sources of vari- 
ability that come from the individual’s imagi- 


native and cognitive processes, an experi- 
mental task should be such as to hold these 
at the lowest possible level. 

To be specific, in terms of the foregoing 
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considerations a task might be said to be 
monotonous to the extent that it (@) involves 
in itself and the total work situation as little 
variability or stimulus change as possible- 
variability should be repetitious to the extent 
that it does occur; (8) demands the indi- 
vidual’s attention as continuously as possible, 
so that imagination and fantasy systems are 
unlikely to develop; (c) is sufficiently struc- 
tured and planned that a minimum of cog- 
nitive activity is required in its performance. 

The laboratory task developed to meet 
these criteria required each subject to hand 
print continuously, at a paced rate, a se- 
quence of seven pairs of letters. In com- 
parison to most procedures used to test 
“perceptual vigilance” (Broadbent, 1953), 
this task has the advantage of having the 
subject continuously and actively involved, 
so that lapses of alertness can be traced to 
the exact time of occurrence. It also resem- 
bles more closely the machine paced condi- 
tions of performance which characterize many 
production line jobs. 


Arousal and Hypnotic Susceptibility 


Long distance truck driving, especially 
at night, is a job which comes close to meet- 
ing the criteria of monotony given above. 
The Harvard School of Public Health study 
of Human Fectors in Highway Transport 
Safety (McFarland & Moseley, 1954, p 
124-125) points out that hallucinations are 
a recognized hazard of this job. The isolation 
studies (Bexton et al., 1954) showed that 
reducing stimulus input frequently leads to 
various types of hallucinations. Ammunition 
inspectors have been reported as “falling 
asleep” at this highly repetitious visual task, 
frequently relatively early in a shift.* The 
resemblance of these occurrences to phe- 
nomena which are common in the hypnotic 
state suggested a relation between the indi- 
vidual’s hypnotic susceptibility and his re- 
action to a low variability stimulus situation 
Though this suspected relation may be 
tangential to the effects of noise, its investi- 
gation was thought likely to add to the 
understanding of behavior in a monotonous 
work situation. 


2E. C. Webster, personnel communication, 1956 
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Experimental Hypotheses 


The major experimental hypothesis is im- 
plicit in the arousal hypothesis, which pre- 
dicts lowered efficiency following the reduc- 
tion of environmental stimulation to low 
levels. In a monotonous work situation 
(defined in terms of a very low level of 
stimulus change) the introduction of noise, 
by increasing variability and hence arousal, 
should lead to improved performance.* As 
previously noted, the noise introduced should 
be low in intelligibility, otherwise its distract- 
ing effect may mask any performance im- 
provement attributable to increased arousal. 

A second hypothesis asserted that a rela- 
tion would be found between a standard 
measure of susceptibility to hypnosis and the 
amount of performance decrement in the task 
occurring from conditions of noise to condi- 
tions of minimal variability. 

An additional purpose of the investigation 
was to assess the laboratory task itself as a 
reliable index of interindividual differences 
in performance under monotonous work con- 
ditions. If demonstrated to be reliable, the 
resulting increase in behavioral sampling 
should lead to improved validity of selection 
for such jobs (McBain, 1957). 


METHOD 


Subjec Thirty male members of the 
Canadian Air Force formed the group. 
Their ranged from 19 to with a 
mean of 25.8. All, except two of the three officers 
in the sample, were nonflying personnel. Attrition 
unscorable records, failure, and 
equating of groups reduced the N to 26 or less for 
most data presented. 
Procedure* Each subject 
minute sessions of work at 
almost all subjects these were spaced at exactly 
one-week intervals. Prior to these sessions, each 
subject was administered a slightly modified form 
of the Friedlander and Sarbin (1938) Scale of 
Hypnotic Depth, essentially an instrument which 
gives a score reflecting the individual’s reaction or 
susceptibility to a measured “dose” of hypnotic 
stimuli 


Royal 
original 


ages years 


from mechanical 


completed four 42- 
a monotonous task. For 


8 Scott’s (1954) unpublished suggestion to this 
effect is one of the experiment re- 
ported. Deese (1955) published a similar suggestion 
at about the same time 

*The complete experimental pr 
in the project terminal 
Defence Research 


bases for the 


col is contained 
submitted to the 
Canada 


report 


Board of 


The Monotonous Work Task. A laboratory 
was devised to fit the criteria of a monotonous 
job, as defined above. This consisted of hand print 
ing continuously in sequence the seven pairs of 
letters: KT, LH, IM, XF, KV, TZ, IW. Each of 
the pairs consisted of letters which were easily 
discriminable for scoring purposes and in ordinary 
printing each required the same number of strokes 
Prior testing demonstrated the sequence to be 
highly confusing. This, combined with pacing, helped 
to meet the task criterion of 
manding. To reduce even further the cognitive 
aspects of this highly structured task, the list 
letter pairs was that the 
consult it by briefly looking away from the print 
ing surface 

The requi 
total several mea! 
Intruding were masked to a con 
siderable extent by the continuous operation of a 
powerful exhaust fan during sessions, so that the 
only variable sounds in the experimental room were 
the rhythmic timing and 
system. Visual variability was reduced by 
the performance carried out in a 
cubicle which was visually 
of the experimental 
was controlled to extent by 
subject to move about as little 

At the beginning of the first work 
subject was given a which required rapid 
copying of the letter pairs on a prepared test blank 
Three trials given. The subject 
Was encouraged to quickly as 
For the first three of the succeeding 42-minuté 
sessions each subject was required to respond at 
three-fifths of his average rate on the two fastest 
pretest trials. On the fourth 
was required to 
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rement of minimum variability 
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clicks of the recording 
having 
black draped 
from the re 
Kinesthetic 


isolated 
room variability 
cautioning 


as possible 


some 


session € 
pretest 
36-second were 


print as possible 


session each su 


work at a slower rate 


The pacing apparatus presented to the 
7/8" «1 


a which ran a 
tinuous tape of white paper. This advanced inter 
mittently at the rate set for each subject, and 
such a manner that the previously printed pair was 
immediately concealed. Each time the subject mad 
an error (defined as “anything in the space except 
the next pair of letters in the 
legibly and completely”) he 
his awareness of this by 


opening beneath 


sequence, printe 
was required to signal 
means of a foot pedal 
If the subject lost his place in the sequence he was 
required to begin again at the first pair, and was 
informed that this counted as an error. Subjects 
were instructed to make as few errors as possib! 
Three conditions } 
Under Quiet (Q) conditions the 
only sounds in the experimental room were the 
rhythmic clicks of the apparatus and the masking 
sound of the fan. During the entire period of the 
Noise (N) sessions a magnetic tape was played 
Its content was considered to be low in intelligibil 
ity, since it was basically a recording of 
played in specifically, part of a 
management conference. To add to its 


Condition basic 


the four 


were used 


sessions 


speech 
labor 


variabilit 


reverse, 
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there were superimposed short fragments of in- 
telligible conversation, meaningless sounds, 
etc., and the loudness was varied unsystematically 
short periods of complete silence and near 
inaudibility to a degree which approached the dis- 
comfort level. Each subject was exposed to the 
portion of the tape recording at the same 
intensity. After being told that noise 
would be used, the subject was instructed 


music, 


irom 


same 


recorded 


Try not to let it affect work at all, but 
just work straight ahead as you did before, trying 
to make as few errors as possible. Some people 
think this sort of work background relieves the 
monotony ... others think it is distracting. 
However, we'd like you to work straight on, 
paying as little attention to it as possible 


your 


The final session for all subjects termed 
the Latency (L) It was the same as the 
Q session except that (a) the speed of response was 
from three-fifths to one-half the pretest 
rate and (b) an additional response was required 
of all subjects, which involved a slight modification 
of the apparatus. 

\ small lamp was added to the apparatus, po- 
sitioned about 6 inches beyond the printing aperture 
from the subject. Next to it was a 
On 11 occasions during the session, at 
intervals of 2-6 minutes, but the 
subject, the lamp was 


was 
session. 


slowed 


push bution. 
unsystematic 
same for each 
turned on at exactly the 
time of the paper shift. The subject was instructed 
to “put it out by pushing the button as fast as 
possible, without either putting down your pen or 
missing a turn, and before you print the two letters 
in the square.” To make this task more discrimi- 
nating the 6-volt lamp was supplied from a 3-volt 
current source, which had the effect of causing 
it to glow rather than to shine brightly. Each sub- 
ject was given five practice light signals prior to be- 
ginning the scored trials 

All subjects worked under Q conditions during 
their first monotonous work They were 
then divided into two groups, equated on the basis 
of proportion of errors and total number of re- 
sponses required during the first 42-minute session. 
In the second session one of these groups performed 
under Q conditions, the other under N conditions 
In the third session the conditions of 
were reversed, while in the fourth 
jects worked under L conditions 
each session of each subject readings 
taken at regular intervals of the level of 
galvanic skin response. Since these data have little 
applied interest they are not included in the present 
report. 

Treatment of Data. For each subject the follow- 
ing scores were computed 


session 


performance 
session all sub- 


During 
were 


1. The Error Index (EI) the num- 
ber of response errors for each thousand responses 
required, and was computed for each session and 
for the four sessions combined 


consisted of 


2. The Signal Index (SI) was the percentage of 
errors scored which was signaled by the subject 
It was computed for each session, and for the four 
sessions combined 

3. The Latency Index (LI) was secured from 
the kymograph records of the final session. The linear 
distances between “on” and “off” signals for the final 
10 of the 11 trials were summated for each subject 
Since relative rather than absolute times were re- 
quired, this index was not converted to a time score 

4. The Hypnotizability Index (HI) was the score 
on the Friedlander and Sarbin scale. High scores 
indicate greater, and low scores lesser, susceptibility 
to hypnotic stimuli. The subjects were considered 
“high” or “low” on this index as they fell above 
or below the median for the group 


RESULTS 
Noise, Hypnotizability, and Performance 


The original experimental plan called for 
groups matched on Session I to perform on 
Sessions IT and III in a counterbalanced de- 
sign. With this intention thwarted by per- 
verse apparatus and subjects, it was decided 
to analyse the results of equated rather than 
matched groups, using a complex analysis 
of variance design with three dimensions: ° 
Condition (N vs. Q—correlated), Order of 
Conditions (NQ vs. QN—correlated), Hyp- 
notizability (High vs. Low—uncorrelated). 

Since measures under the two conditions 
were available only for EI and SI scores, 
separate groups were equated on these two 
measures for the first session, which all sub- 
jects performed under the same (Q) condi- 
tions. Tables 1 and 2 demonstrate that these 
groups were not significantly different. The 
results of Sessions II and III were then 


5Cynthia Wimer planned and performed the 
analysis presented 


TABLE 1 
EQUATING OF EXPERIMENTAL Groups ON Error INDEX 
EI) PERFORMANCE IN SEssION I 
(N = 24) 


Source of Variation SS df 


Hypnotizability 2 
Order (of N & Q conditions) 95 
HxO 799 

6,062 


Interaction 
Error 
Total 6,998 


* Subjects 5 and 
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TABLE 2 


OF EXPERIMENTAI OUPS ON SIGNAI 
INDEX (SI 


EQUATING 
PERFORMANCE IN SESSION I 


N 26 


Table 
Table 4 


analyzed, with the results shown in 
3 (groups equated for EI) and 
(groups equated for SI). 

In brief, the results from these analyses 


: ] ¢ }. 
Inaicateda: 


1. The difference in mean EI between N 
conditions (12.22) and Q conditions (16.39) 
of 4.17 errors per thousand required re- 
sponses is significant beyond the 5% level 
of confidence. As measured by the making 
of errors, performance under conditions of 
noise is superior to performance under quiet 
conditions. 

2. The difference in mean SI between N 
conditions (55.13) and Q conditions (56.45) 

1.32% of errors signaled is not signifi- 
cant. As measured by the stgnaling of errors, 
performance under conditions of noise is not 
significantly different from that under quiet 
conditions, though the 


percentage of errors 


PERFORMANCI 


10,804 


rABLE 4 
SIS OF VARIANCE OF SIGNAL INDEX (SI 
iN Sessions II anp III 


VY = 26 


RFORMANCE 


signaled conditions 
greater. 

3. There is a highly significant interaction 
between Order and Condition in their 
tion to SI. This can best be understood as a 
practice effect, ie., there is a tendency for 
the signaling of errors to be more 
under the condition experi- 
enced second. There is no such effect in re- 
gard to the making of errors 

4. There is no difference in mean EI be- 
tween subjects with low and with high HI 
However, the mean SI for subjects with low 
HI (69.34) and for subjects with high HI 
(42.24) showed a difference of 27.1 in per- 


under quiet 


is slightly 


rela- 


accurate 
performance 


centage of errors signaled, which is significant 
at beyond the 5% level. While persons who 
are least susceptible to hypnosis make no 
fewer errors than those who are 
they do signal the 
with significantly greater accuracy 
The mean LI was determined in 


most SuUS- 


errors made 


ceptible, 


session 


IV for subjects low in hypnotizability (29.8) 
and those high in this characteristic (30.9) 
The difference of 1.1, 
susceptible to 


in favor of those least 


hypnosis responding more 


quickly, was not significant 


Indices 


“haractertstics o he Performance 
Ch terist f the Perfor 


It seemed possible that a task of this gen- 
eral type might prove useful in the selection 
of personnel for 
monotonous 


jobs of an unavoidably 
nature. For this purpose it 
should demonstrate reasonably wide and con- 
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sistent differences among individuals. Table 
5 indicates that even after more than 2 
hours practice on this relatively simple task 
subjects are reasonably well distributed on 
both EI and SI. An examination of the table 
indicates a relatively consistent lowering of 
the mean errors and narrowing of the spread 
of scores in the EI which is not shown in 
the SI. It is thought that the latter observa- 
tion reflects the inadequacy of the SI as a 
statistic. As the number of errors becomes 
small a very small absolute change in the 
number signaled changes the SI tremend- 
ously. For example, a subject having only 
one error will secure an SI of 100 if he sig- 
nals it, while his SI is O if he fails to signal 
it. 

The reliability of the El was estimated 
for Session I by the split-half method. The 
errors for successive 2-minute periods (with 
the exception of the first 2 minutes) were 
summated so that errors for Minutes 3, 4; 
7, 8; 11, 12; etc. were correlated with 
errors from Minutes 5, 6; 9, 10; 13, 14; ete. 
This gave a coefficient of reliability of .84, 
which increased to .92 when the Spearman- 
Brown correction for length was applied. 

Since it is possible that errors in one 2- 
minute period may influence errors in the 
successive one, and hence lead to a spuri- 
ously high coefficient, the errors in session 
II were correlated with those in session III. 
While it is true that half the subjects worked 
under different conditions in Sessions II and 
III, it may also be assumed that, even under 


TABLE 5 
ScorREs FOR 26 Ss In Four MonoTonous 
WorK SESSIONS 


Error Index (ET) Signal Index (SI) 


Extreme 
Scores 


Extreme 


Session Ganson 


Low- High Low- High 
est est est est 
I |30.2 21.9 0 
II |15.9 16.8 0 
III |14.2 191 0 
IV {12.0 10.6 1.2 42.1 


2 100 
46.6 28.6 100 
61.8 30.1 100 
52.5 31.1 100 


50.4 25 
22 


g 


N conditions the task is a monotonous one, 
though not as monotonous as under Q con- 
ditions. For 24 subjects errors in Session I] 
vs. errors in Session III showed a correlation 
of .84, a reasonable finding for a test-retest 
reliability after one week, considering both 
the disparate conditions and the restriction 
of range following Session I. Both these find- 
ings indicate a sufficiently high degree of 
reliability for the EI as a performance meas- 
ure to make its use feasible as a predictor 
in an industrial situation. 

The reliability of the SI, determined as a 
test-retest coefficient between sessions II and 
III, was found to be .56, a result most 
probably attributable to the instability of the 
index when small ‘numbers of errors are made. 
From this result it is clear that the SI com- 
puted in this manner is not an adequate per- 
formance measure for prediction in a per- 
sonnel situation, even though it has been 
shown to discriminate between groups se- 
lected on the basis of hypnotizability. 

The reliability of the LI was estimated 
by summating the latencies for signals given 
at Minutes 3, 9, 17, 33, and 41, and at 
Minutes 5, 15, 23, 27, and 35 for each 
subject and correlating the resulting pairs 
of totals. Each of the two sums contained 
two latencies secured from signals given 
after 2 minutes of uninterrupted work, one 
from a signal given after 4 minutes, and 
two from signals given after 6 minutes, 
though these intervals occurred in different 
orders in the two groups of signals sum- 
mated. The resulting split-half reliability, 
corrected for length, was found to be r - 


‘85, which is of a magnitude usually consid- 


ered sufficient for use in prediction as well 
as for comparison of group results. 

The interrelation among indices was de- 
termined by computing correlations which 
used mean measures for all four sessions for 
the EI and the SI and the single determina- 
tion of LI from Session IV. The three meas- 
ures were all intended to be indications of 
the “alertness” of subjects. Thus, although 
they could be considered relatively inde- 
pendent in terms of experimental procedures, 
it was anticipated that they would show a 
reasonable degree of interrelation. For 26 
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subjects EI was found to correlate with SI 
.28 and with LI .04 while LI and SI also 
showed a correlation of .04. Since a correla- 
tion of .388 is required for significance at 
the 5% level with 26 pairs of scores, the 
hypothesis implicit in the selection of these 
measures of alertness is clearly untenable. 
The findings suggest that alertness is not a 
unitary characteristic in work behavior, and 
that persons who can be depended upon to 
perform adequately on a routine, repetitive 
task which requires continuous attention 
(EI) are not necessarily those who will be 
most critical of the adequacy of their per- 
formance (SI) or who will react most quickly 
to an irrelevant interjected stimulus (LI). 


DISCUSSION 
Arousal and Vigilance Tasks 


The majority of recent studies concerned 
with the effects of noise on human perform- 
ance have secured data from tasks of “vigi- 
lance,” in which the subject typically had 
to respond “only to very infrequent signals 
but may have to watch for them over long 
periods” (Broadbent, 1958, p. 108). Two 
other features are characteristic of the stud- 
ies summarized by Broadbent. They are 
primarily concerned with decrements in per- 
formance over the length of the period during 
which exposure to noise occurs. More im- 
portant to the present study, they usually 
use relatively homogeneous noise, specified 
as to frequency band or spectrum and as to 
intensity. Such noise adds no variability to 
the work situation, but rather adds to its 
monotony, since the proportion of total stimu- 
lation which is nonvariable or monotonous 
is increased. It is tempting to maintain that 
within-session performance decrements oc- 
curring under such circumstances may be 
more adequately explained by a gradual re- 
duction in arousal attributable to the low 
variability of the work situation than by an 
appeal to “psychological stress” (Jerison, 
1959). 


The present study lends no support to such 
a position. In all except the first (or train- 
ing) session, whether or not noise was used, 
errors increased with time. A graphic repre- 


sentation of errors summated for each 6- 
minute period suggests both that the slopes 
of error curves for the Q, N, and L sessions 
are not significantly different and that the 
curve for the N session shows a considerably 
smoother rise. Incomplete records did not 
allow a more accurate check of these ap- 
parent trends. 

Since there is no evidence that within- 
session performance decrement is affected by 
highly variable noise, it must be concluded 
tentatively that the arousal hypothesis does 
not account for the decrease in accuracy 
which is of most interest to investigators of 
vigilance tasks. Indeed, it seems that the 
increase in stimulus variability brought 
about by the noise acted uniformly through- 
out the session to reduce significantly the 
proportion of errors. Whether or not the 
error curve rises more uniformly under con- 
ditions of variability is a question for fur- 
ther investigation. 


Alertness and Hypnotic Susceptibility 


One way of interpreting the signaling of 
errors is as a measure of the extent to 
which the subject is critical of his perform- 
ance. While peripheral to the question of the 
effect of noise on performance, the finding 
that those who signal errors most poorly 
are most susceptible to hypnosis deserves 
further mention. A critical attitude is a rec- 
ognized deterrent to the induction of hyp- 
nosis. If a truck driver took such an attitude 
to the presence of a colonial house in the 
middle of the road (McFarland & Mosely, 
1954, p. 124, Case 2) it is doubtful that an 
hallucination could become fully developed. 

The magnitude of the relation between 
susceptibility to hypnosis and awareness of 
errors is indicated by the biserial correlation 
between high or low HI and the composite 
SI for the two sessions performed under Q 
conditions—ry;, =.46 (p = < .01). When the 
same statistic is computed, using a composite 
SI which also includes scores from the N 
sessions the resulting correlation is not sig- 
nificant (rpis = .28). This suggests that sus- 
ceptibility to hypnosis is most likely to be a 
performance relevant variable under highly 
monotonous work conditions. 
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Utility and Limitations of the Findings 


The experimental monotonous task used 
in this study has been demonstrated to pro- 
vide stable measures of errors (EI) and 
latency (LI), while further development 
might provide an equally adequate index of 
“awareness” of errors. These may reasonably 
be expected to predict performance in 
monotonous industrial jobs. However, there 
are certain considerations that suggest they 
be used and interpreted with caution. 

The first of these is the finding from the 
present study that alertness appears not to 
be a unitary characteristic of the individual. 
A very careful criterion analysis must there- 
fore precede attempts to validate such pre- 
dictors, so that the one most relevant to 
desired performance may be used. 

The second consideration has to do with 
the relation between the reaction of the 
individual to understimulating environments 
and his reaction to those which provide over- 
stimulation. We have at present no indica- 
tion of whether a relation exists between 
these two adverse reactions or, if it does, 


whether it is positive or negative. A positive 


relation would indicate the possibility of 
hiring workers whose performance would be 
relatively independent of conditions of en- 
vironmental stimulation. If a negative rela- 
tion exists it would suggest caution in hiring 
for monotonous jobs solely on the basis of 
this sort of predictor. In an extreme situa- 
tion we might find our work force virtually 
helpless in the face of the overstimulation 
brought about by an emergency. 

A third factor which should be investi- 
gated further is the question of adaptation 
to stimulus variability. Variability, by its 
very nature, cannot be augmented and pro- 
longed indefinitely. Hence it will be im- 
portant to know whether a certain level of 
variability continues to be associated with 
improved performance over an extended pe- 
riod of time. 

Still another question to ask is whether 
predictive and concurrent validities for 
monotonous types of jobs and their predic- 
tors would be at all similar in magnitude. 
It may be that attrition or self-selection in 
monotonous jobs is an even more potent 


William N. 


McBain 


factor in range restriction than we have to 
deal with in most predictor variables. Hence 
we should be alert for the situation in which 
a barely significant relation, as determined 
on present employees, becomes a highly effi- 
cient predictor when used with applicants. 

Finally, one must consider the question of 
motivation, since variations in motivation 
may play a critical part in the observed 
performance quite distinct from that played 
by the physical conditions of work. Consider- 
able evidence has accumulated to show that 
unfavorable conditions of work may be com- 
pensated for within limits by increasing the 
incentive (Pepler, 1954). This suggests that 
unfavorable conditions may do more to in- 
hibit a worker’s desire to achieve greater 
production than his ability to do so. Simi- 
larly, variability introduced into the monoto- 
nous work environment may make it possible 
to perform more accurately without ensuring 
that more accurate work will result. In any 
short-range experiment there are bound to 
be idiosyncratic motivational effects which 
are atypical in terms of a routine work situ- 
ation. For these several reasons a test in 
some sort of routine production situation will 
be necessary before the practical implications 
of this study can be assessed adequately. 


SUMMARY 


The contradictory findings concerning the 
effects of noise on performance may be rec- 
onciled by a dimensional analysis of the 
characteristics of the noise and of the task 
involved, and an attack upon specific dimen- 
sions, based upon a theoretical rather than 
a strictly empirical approach. In terms of 
the “arousal hypothesis,” noise which is low 
in “intelligibility” (or distraction value for 
the individual), while at the same time being 
high in variability, should enhance perform- 
ance in a monotonous task. 

The laboratory task which was devised 
to conform to the criteria established for a 
“monotonous” work situation consisted of 
42-minute periods of handprinting pairs of 
letters in continuous sequence at predeter- 
mined, individually paced rates. Two groups 
of male subjects equated on performance in 
a first session, were exposed to noise of the 
specified type in counterbalanced order in 
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either a second or third similar session. A 
significant improvement in performance in 
terms of errors made in the task was as- 
sociated with exposure to noise. Awareness 
of errors, as indicated by their signaling, 
was unchanged. 

The similarity of phenomena associated 
with low stimulus environments and the 
hypnotic state suggested the obtaining of a 
standard measure of susceptibility to hyp- 
nosis from all subjects. Signaling of errors 
was significantly more accurate by those 
least susceptible to hypnosis, though the 
making of errors by subjects of low and high 
susceptibility was not significantly different. 

In a fourth session a measure of latency 
of response to a series of unsystematically 
spaced visual signals from a low intensity 
light was recorded. The three measures of 
“alertness”—errors made, errors signaled, 
and latency—showed no significant inter- 
correlation, suggesting this characteristic is 
not unitary. The reliability of error and 
latency measures was sufficient to make them 
practicable in a personnel selection situation 

The implications of these findings are dis- 
cussed in terms of their relation to “vigi- 
lance’ tasks, and their applicability to per- 
sonnel selection practice. The question of 
long-term adaptation to environmental vari- 
ability is also considered. 
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A VERIFICATION SCALE FOR THE STRONG VOCATIONAL 
INTEREST BLANK, MEN’S FORM 


ROBERT W. FILBECK 


University of Nebraska 


It is generally recognized that an occasional 
subject will respond to paper-pencil inven- 
tories in an invalid manner. Some subjects 
may fake their responses. Others will mark 
their answer sheets haphazardly or at random. 
Carelessness, improper motivation, and failure 
to comprehend inventory items or marking in- 
structions are the more frequent reasons for 
invalid responding of a random or haphazard 
nature. 

In view of the factors responsible for ran- 
dom responding being uncontrollable and un- 
detectable during most test administrations, it 
seems advisable to devise, if possible, a means 
of identifying profiles derived from haphaz- 
ardly marked answer sheets. This is particu- 
larly true of the Strong Vocational Interest 
Blank, Men’s Form (SVIB), since this in- 
strument is one of the most frequently used 
instruments in counseling and in research. 

The problem posed here is not new. Strong 
(1943) determined, through die tossing, the 
characteristics of profiles derived from ran- 
domly marked SVIB answer sheets. Chance 
levels on each scale are denoted on the profile 
sheet as shaded areas. The vocational inter- 
ests of dice then will fall within the shaded 
areas. The vocational interests of some real 
people also will fall in this area and the coun- 
selor is unable to determine with any reason- 
able degree of confidence whether a given 
profile is the result of chance answering or 
is actually a validly undifferentiated interest 
pattern. 

Authors of other inventories similar to the 
SVIB have approached the problem of identi- 
fying random responding through construc- 
tion of special scales (Callis, 1948; Hath- 
away & McKinley, 1945; Kuder, 1956). Such 
scales, termed “validity” or “verification” 
scales (V scales), were constructed by scor- 
ing for item responses chosen rarely in real 
testing and significantly more often by chance. 
(The converse was true for the Kuder V 
scale.) 


ROBERT CALLIS 


University of Missouri 


THE PROBLEM 


The purpose of this investigation was to 
construct and validate a V scale for the SVIB. 
The V scale construction procedures approxi- 
mated those employed by Kuder, Hathaway 
and McKinley, and Callis in developing “rare 
response” scales for other inventories. 

Since the rationale underlying a rare re- 
sponse scale defines deviant scores in the 
chance direction as being indicative of either 
random responding or of highly unusual inter- 
ests, an attempt was made to construct a scale 
that would provide a range of scores that 
would be obtained infrequently either in the 
student population or from random respond- 
ing. This “genuine but unusual” level would 
fall at an intermediate position to the typical 
and chance levels on the V scale. It was hy- 
pothesized that the intermediate level would 
be provided by including items in the scale 
that were rarely selected by college students, 
but of a lesser degree of rarity than commonly 
required. For this reason, the criterion for 
rarity was a difference between obtained and 
chance response frequencies significant at the 
.10 level rather than the more stringent cri- 
teria of the .05 and .01 levels. 


PROCEDURE 


The construction sample was composed of 192 
freshmen enrolled in the University of Missouri dur- 
ing the 1955-56 school year. The total sample was 
divided into eight division-by-sex subsamples as 
follows 

MALES 
Arts and Science 
Agriculture 
Education 
Engineering 


FEMALES 
Arts and Science 
Agriculture 
Education 
Nursing 
Each subsample, except males in Education, con- 
tained 25 subjects. Only 17 subjects were available 
for inclusion in the Education males subsample. 

The SVIB had originally been administered to a 
group of approximately 400 freshmen for purposes 
of a larger study, and the SVIB answer sheets of the 
construction sample were selected by random means 
from this population. 
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The first step in isolating rare item-responses con- 
sisted of contrasting the response frequency for the 
total construction sample with the frequency ex- 
pected from chance (33%, since there are three item- 
responses for each item). The index used was the phi 
coefficient (Jurgenson, 1947). The criterion for rarity 
was a phi significant at the .10 level (# = .127), 
the obt being less than the 
frequency. 

Next, the response frequency for each item ri 
sponse contrasted with chance expectancy for 
each division-by-sex subsample. The criterion for ac 
ceptance here was chance frequency exceeding th 
obtained frequency by 10% 


with 


uined frequency chance 


was 


RESULTS 


> 


These procedures yielded a V scale of 103 
item-responses, all unit weighted in the posi- 
tive direction, and distributed among 97 items 
The SVIB item numbers and item responses 
scored on the V scale key are listed in Table 1! 
Validity 

Initial validation of the SVIB V scale was a 
test of the ability of the scale to discriminate 


between genuine and chance marked answer 


TABLE 1 
AND RESPONSI 
SVIB 


SVIB Items 


SCORED ON THI 


204. D 
205. D 
206. D 264 
207. D 265 
D 268 
D 270. 
D 271 


D 272 


ra A 


261. 


262. 


I, 273 
L 275 
# 276 
L 277 
L 279. 
D 280 
D 284 
D 298 
L 315 
s 317 
L 
L 
D 
L 
D 
L 


RAN ON 
Soa uU ke wr — 


x 


for SVIB 319 


sheets. Since, with large numbers, relatively 
small scale distances between means wi! be 
statistically significant, a difference-betwecen- 
means criterion for validity was not used. In 
stead, percentage of overlap of the two cri- 
terion distributions was considered a proper 
index of validity. If the distribution 
means were clearly separated and overlap 


two 


was so slight as to permit rather unambiguous 
dichotomization, the scale would be consid- 
ered valid for the purpose stated here. 

The cross-validation sample was composed 
of 908 subjects; 409 male and 249 female 
freshmen from the University of Missouri, 
100 male clients selected at random from the 
files of the University of Missouri Testing 
and Counseling Service, 100 male freshmen 
from the University of Minnesota,’ and 50 
males of upper class and graduate status from 
Central Missouri State College. The V 
mean and SD 
sample were 8.55 and 4.73, respective 


scale 
the total cross-validatior 
ly. The 
mean and SD of the theoretical chance dis- 
tribution were computed to be 34.4 and 4.6, 
respectively.2 The two distributions are de- 
picted in Figure 1 

Examination of 


f¢ Tr 


Figure 1 reveals the va- 
lidity criterion to be amply satisfied. The two 
distributions are clearly differentiated, more 
than five SDs separating the two means 
While it is obviously impossible to estab 
lish a cutting score which will permit perfect 
dichotomizing of V scores into real or chance 
categories, it is possible to sort answer sheets 
into real or chance groups with about 99% 
accuracy if the cutting score is set at V score 
equal 23. Just less than 1 in 100 chance-an- 


1 The writers wish to thank Ralph Berdie for 
cooperation in furnishing SVIB records from the Uni 
versity of Minnesota. 

2 Statistics of the theoretical chance distributio 
computed from the following formulas 

Ni +2N 
3 
SD=WVN,PQ+N2PO 
where N2,=1 


S] ONS 


umber of items contributing one iten 


N:=number of items contributing two iten 


sponses 


P=probability of chance marking 


item-response for each item 


Q=probability of chance marking of 


scale item-response for each iter 
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swered inventories will have V scores of less 
than 23, while 1.29% of the assumed genu- 
inely answered inventories score at this value 
or higher. 


Sex and Academic Group Differences on the 
V Scale 


Although the procedures followed in the 
construction of the V scale held to a minimum 
the likelihood of obtaining V scale differences 
among student groups classified as to aca- 
demic affiliation or sex, it was desirable to 
determine on a cross-validation sample if 
this, in fact, was accomplished. For this test 
the distributions of the four male and four 
female validation subsamples from the Uni- 
versity of Missouri were contrasted. The 
means and SDs of these subsamples are pre- 
sented in Table 2. 

The data in Table 2 indicate the construc- 
tion procedures to have been successful in 
providing a scale of item responses which are 
rarely selected by university students, regard- 
less of sex or curricular affiliation. However, 
even the small differences found here are too 
great to be charged to chance sampling ef- 
fects. Analysis of variance techniques yielded 
an F ratio of 2.21, significant at between the 
.04 and .03 levels. 

The finding of a significant value of F in 
this instance does not require any substantial 


Obtained and theoretical chance distributions on the SVIB V scale 


modification of interpretation of a client’s V 
score because of his curricular affiliation how- 
ever. The differences between groups are too 
small, two raw scores separating the means of 
the two extreme groups, to be interpretable in 
the practical sense. 


Institutional Differences on the V Scale 


To test the possibility that populations in 
institutions of higher education other than 


TABLE 2 


V ScALE MEANS AND STANDARD DEVIATIONS OF 


E1cut UNIVERSITY OF Missouri Cross 


VALIDATION SAMPLES 


Males 
Arts and Scien 
Agriculture 
Engineering 
Counseling Client 
Females 
Arts and Sciences 
Agriculture 
Education 
Nursing 
Potal 


* An analysis of variance test for significance of the differences 
among these means indicated only a slight tenden to sig 
nificance (F =2.2 04 <p >.03) 


I 
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the University of Missouri will score differ- 
ently on the V scale, the V scale distributions 
of the male samples from the three afore- 
mentioned institutions were contrasted. The 
means and SDs of the three samples appear 
in Table 3. Determination of the likelihood of 
the sample differences arising by chance ef- 
fects was by analysis of variance techniques. 
An F ratio of 2.76, not significant at the .05 
level, was obtained; offering no contrary evi- 
dence to a hypothesis of random sampling 
from populations of equal means 


Reliability 


Internal consistency of the V scale was esti- 
mated from the total University of Missouri 
sample, using Kuder-Richardson Formula No. 
3 (Adkins, 1947). An 7 of .66 was obtained, 
which may be considered an underestimate 
since the assumption of equal item difficulty 
was not met. The desired degree of internal 
consistency is difficult to specify. There are 
no data available which would suggest that 
such a V scale should have high or 
ternal consistency. 

D. Brantley (1958 unpublished) readmin- 
istered the SVIB with standard instructions 
to a group of 25 males, allowing a 2-week in- 
terval between administrations. He obtained a 
V scale test-retest r of .80. 


low in- 


Relationship of V Scale to Other SVIB Scales 
Using the 100-male freshmen constituting 
the University of Minnesota sample, Pearson 


product-moment correlations were computed 
between the V scale and each of the 
the SVIB profile. In the main, the r’s were 


scales on 


low, less than half departing significantly 


rABLE 3 
V ScALE MEANS AND STANDARD DEVIATION 
SAMPLES FROM THREE INSTITUTIOD 
HiGHER EpucaTIon 


Institution 


Central Missouri State College 
University of Minnesota 


University of Missouri 


rABLE 4 
SIGNIFICANT CORRELATIONS BETWEEN SVIB 
PROFILE SCALES AND THE SVIB V ScALE 


Scale 


Artist 
Veterinaria 

Farmer 

\viator 

Printer 

Forest Service Mar 
YMCA Physical Direct 
Personnel Director 
Public Adn 
YM¢ 


Social Scier 


inistrat 

\ Secretary 

e High Schor 
City School Superinter 
Social Worker 
Musiciar 

CPA 

Senior CPA 
Advertising Ma 
Lawyer 

Author Journalist 
Occupational Lev 


from zero. The r’s which were significant (p 
05 and p < .01) are listed in Table 4. 
Noting the tendency for higher V scores to 

accompany interests in the social welfare area 

19 profiles having a Group V primary interest 

pattern were contrasted to those not so char- 

acterized. The “Group V” profiles had a mean 

V score of 7.1, 

mean V 


the contrasted group had a 
score of 8.8. Failure to obtain a dif 
ference in the expected direction in this test 
would seem to indicate that no modification 
of V scale interpretation need be made on ac- 
count of measured interests 
V Scale Vorms 

Standard score equivalents of SVIB V scores 
are given in Table 5. Table 5 was derived 
from the V scores of the total cross-validation 
sample of 908 subjects 

Because of marked skewness of the student 
distribution (see Figure 1) scaling based on 
normal curve procedures was inappropriate, 
so the T score equivalents in Table 5 were de- 
rived from an area transformation (Guilford 
1950). 
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TABLE 5 


Norms FOR THE SVIB V Scat 


Raw Score T Score* Raw Score T Score* 


0 
21 
27 


31 


“anns 
whe dN 


4st 7A) 4 
nN uUuore 


mu ¢ 
ray 
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81 


standard deviaticen 
lfor 1950). 


Interpretation of SVIB V Scores 


In the statement of the problem it was 
pointed out that use of the V scale should 
permit classification of SVIB answer sheets 
into three categories: genuine and typical, 
genuine but deviant, and chance or random 
response. From Figure 1, it is apparent that 
the genuine/typical and the chance categories 
are Clearly differentiated. Also apparent is the 
existence of a range of scores near the cross- 
over point of the two distributions that in- 
cludes relatively few cases from either dis- 
tribution. 

Establishing cutting scores to define the 
limits of each category, in the absence of em- 
pirical evidence, has been approached arbi- 
trarily, relying on the experiences of authors 
of other scales. 

Earlier, it was demonstrated that the likeli- 
hood of mistakenly accepting a chance-an- 
swered inventory could be held to less than 1 
in 100 at the expense of rejecting approxi- 
mately 1.3% of the presumably genuinely an- 
swered inventories as being responded to at 
random. Ordinarily, rejection of slightly more 
than 1% would be deemed a reasonable 
“price” to pay for objective assurance of 
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valid testing. However, experience with the F 
scale of the Minnesota Multiphasic Person- 
ality Inventory would indicate that even this 
small percentage may be too great. Hath- 
away and McKinley (1945) point out that 
high scores (7 = 65-80) indicate unusual be- 
havioral characteristics but do not invalidate 
the testing. They do not consider the testing 
questionable at less than T = 80. 

Mindful of this experience, the suggested 
cutting score between genuine and random re- 
sponding on the SVIB V scale is set at 28 
(T = 74). This will hold the likelihood of in- 
cluding a chance answered inventory to less 
than 9 in 100, a reasonable confidence level 
for the purposes specified here. 

The lower boundary of the intermediate or 
“valid but highly unusual” level is more diffi- 
cult to specify rationally or empirically. Hath- 
away and McKinley use the 7 = 65 score as 
a dividing point on the MMPI F scale. In the 
absence of empirical data, a similar dividing 
line is suggested here, thus defining as “highly 
unusual interests’ SVIB profiles having V 
scores 65 through 74 (raw V _ scores 17 
through 28). 

Suggesting the boundaries of unusual inter- 
ests does not, however, define the nature nor 
the extent of ‘“‘unusualness.” Carnes * has pro- 
vided some preliminary information in this 
respect in reporting on the V scale distribu- 
tion obtained from the SVIBs of 40 hospital- 
ized patients in a Veterans Administration 
psychiatric hospital. He had personally ad- 
ministered the inventories under highly indi- 
vidualized conditions, thus giving subjective 
assurance of valid test taking. The mean pa- 
tient V score was 7 = 70 (raw score 21.8) 
and the patient sample SD was 14. The in- 
formation Carnes provides suggests that in 
many individuals, high V scores reflect strong 
conflicting drives which tend to be disorgan- 
izing to the total personality and are more 
determinative of behavior than are interests. 
In predicting the activities an individual with 
a high V score would find satisfying, the coun- 
selor would probably place minimal depend- 
ence on the SVIB profile as such, and would 
resort to other, more clinical, indications of 
drives and motives. 


*C. D. Carnes, personal communication, 1953 





Verification Scale for SVIB 


Effects of Faking on V Scores 


Although the SVIB V scale was not de- 
signed as a device to detect faking, one in- 
vestigation has studied the effects of deliber- 
ate falsification of interests on V scores. 

D. Brantley (1958 unpublished) adminis- 
tered the SVIB to a group of 25 men enrolled 
at Central Missouri State College. The first ad- 
minstration was according to standard instruc- 
tions, the second to fake. The faking instruc- 
tions directed subjects to respond to the SVIB 
as though applying for a highly remunerative 
but intrinsically uninteresting job, to be se- 
lected from the occupations listed on the 
SVIB booklet. The V scores of the faked an- 
swer sheets showed a mean increase of six 
raw score points over the sincere answer 
sheets. Although this increase is significant 
(t = 2.56, p < .05), the mean faking score 
does not approach the unusual interest range. 
Faking, therefore, does not appear to be an 
hypothesis to be attached to higher V scale 
levels. 

SUMMARY 


A “verification scale” (V scale) has been 
constructed for the Strong Vocational Interest 
Blank, Men’s Form. Item analysis of the 
SVIB, based on the responses of 192 male and 
female subjects, isolated 103 item-responses 
which were rarely selected by students. ‘“Rar- 
ity’ was determined by contrasting the ob- 
tained frequency of response with that ex- 
pected from a chance answering of the SVIB. 
The criteria for rarity were differences signifi- 
cant at the .10 level, for the total group, and 
10% difference between obtained and chance 
frequencies for each major curricular and sex 
group. 

Validation studies to date, utilizing a total 
cross-validation sample of 908 subjects, yield 
the following information: 

1. Genuine and chance response profiles 
are well differentiated by the SVIB V scale. 

2. The differences among the mean V 
scores of curricular groups and between sexes 
are minor, although there is an indication that 
males in engineering tend to obtain slightly 
lower V scores. 

3. No significant differences were found 
among the mean V scores of three male sam- 


ples from different institutions of higher edu- 
cation. 

4. V scores in the range T = 65-75 suggest 
personality deviation of a nature requiring 
some modification of SVIB profile inter- 
pretation. 

The reliabilities of the V scale were esti- 
mated to be .66 by means of K-R Formula 
#3 and .80 by test-retest technique when the 
interval between testings was two weeks. 

Coefficients of correlation between the V 
scale and the SVIB profile scales show a sig- 
nificant value of r in 20 instances, although 
the r’s tend to be small. It was determined, 
however, that no differences in V scale inter- 
pretation need be made because of measured 
vocational interests. 

On the basis of present information, coun- 
selors may use the V scale to establish three 
general levels of scores: 

1. T scores of 0-64 represent a range of 
scores which typify answer sheets marked 
with attention and understanding and pre- 
sumably on the basis of “normal” interests. 
The interpretation of SVIB profiles with V 
scores in this range may rather 
straightforwardly. 

2. T scores of 65-74 represent a range of 
scores which indicate an increasing likelihood 
of random responding or of deviant personal 
chracteristics. The interpretation of profiles 
with V scores in this range should be more 
tentative, exploring first the possibilities of 
random responding and then of strong con- 
flicting drives which will tend to negate or 
modify measured interests as predictors of 
future behavior. 

3. T scores of 75 and above are strongly 
indicative of random responding or of ex- 
tremely unusual interests. In these extreme 
cases the counselor would likely readminister 
the SVIB with attention being given to client 
understanding of inventory content and mark- 
ing instructions. V scores in this high range, 
if shown to be the result of attentive and 
comprehending responding, will probably in- 
validate use of the SVIB as a measure of 
interests. 


proceed 


At the present stage of development it is 
appropriate to recommend that the V scale be 
included among the scales currently scored on 
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the SVIB. Its usefulness in establishing re- 
sponse validity is sufficiently established and 
research on the implication of atypical V 


scores will be expedited. 
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Perhaps no subject in marketing has re- 
ceived greater attention in the past few years 
than the relationship between personality 
and purchasing behavior. All of the furor over 
motivation research is clearly predicated on 
the premise that such a relationship exists, 
although some reporters seem to assume that 
all persons are, at base, alike. Yet even here, 
the factors referred to as common to all 
persons are most often those which personality 
studies have shown to be variables rather 
than constants. For instance, the importance 
of fear of the father image, which is reputed 
to militate against the use of banking serv- 
ices, must be conceived of as varying with 
some personality characteristic such as ego 
strength or emotional maturity if it is not to 
influence all persons in a highly similar way. 

Talk about the importance of personality 
as a marketing variable has become common 
at advertising clubs and at marketing asso- 


ciation meetings. The recent book by Pierre 
Martineau (1957) contains a chapter entitled 


“An Automobile for Every Personality.” 
Charles Cannell (Ferber & Wales, 1958) says: 
“It may be that the determination of airplane 
travel has something to do with basic per- 
sonality characteristics such as personal feel- 
ings of security or insecurity” (p. 10). And 
Ernest Dichter (Ferber & Wales) says confi- 
dently: “What we are searching for are psy- 
chological and personality elements which 
may have a dynamic effect on consumers’ at- 
titudes toward a product” (p. 26). Newman 
(1957) views personality as one of the major 
factors determining marketing behavior. 

In the light of such points of view it may 
seem surprising that few efforts have been 
made to demonstrate that personality charac- 
teristics actually do influence product use. But 
the dearth of evidence on this point can be ex- 
plained in part by supposition. First, the con- 
cept of personality itself has not been very 
clearly formulated. Second, the instruments 
available for the ready classification of per- 
sonality types are few and generally suspect. 


Third, most self-respecting psychologists are 
apparently convinced that marketing behav- 
ior, pervasive as it may be, is of interest for 
commercial purposes only. Fourth, marketers 
probably have little understanding of the 
need for experimental evidence of their 
assumptions. 

Yet it would seem that there is much to be 
learned about b@th personality and a large 
segment of human behavior by such studies. 
Scott’s (1957) study of motion picture pref- 
erences is perhaps of less interest to the movie 
producer than it is to the individual who 
wants a clearer understanding of the persor 
ality factors isolated by the Minnesota Multi- 
phasic Index. That these factors are less than 
completely clear is indicated by Scott’s in- 
ability to provide a rationale for all of the 
significant correlations. And Eysenck’s (Ey- 
senck, Tarrant, Woolf, & England, 1960) re- 
cent findings that rigidity and extraversion 
relate to the number of cigarets smoked by an 
individual may be as important to the under- 
standing of those characteristics as they are 
as a possible explanation of lung cancer in 
heavy smokers 

The present study was undertaken to test 
the hypothesis that marketing behavior is 
related to personality traits. At the same time, 
it was expected that the location of significant 
relationships would throw additional light on 
the meaning of personality characteristics 
studied 

METHOD 


The Gordon Personal Profile was administered to 
133 students of marketing with a 
Sales and Marketing Personality Index 
cluded questions on the use of headache 
cigarets, chewing gum, deodorants, mouthwash, and 
other items commonly purchased by college stu 
dents. Blind questions were interspersed to give the 
index the a personality or interest 
test. Results were then compared to determine the 
difference in personality trait scores for groups that 
professed to different rates of product use or interest 
That the subjects accepted the index was indicated 
by the number of students who asked after 


so-called 
which in- 
remedies, 


along 


appearance of 


large 
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completing the forms if they could find out whether 
they would make good salesmen, advertisers, etc. 


Subjects 

The subjects were all students of the first course 
in marketing at the University of Texas. The great 
majority were juniors; a few were in the last semes- 
ter of their sophomore year, and others were in the 
beginning of their senior year. Since the Gordon 
Personal Profile has different norms for male and 
female students, and, since the frequency of use of 
a number of products was clearly related to sex, the 
31 responses by females are not included in this 
report. Also, one subject was eliminated because he 
failed to fill out the Gordon Personal Profile com 
pletely. While this group of subjects can hardly be 
characterized as representative of even such a limited 
universe as college juniors, for purposes of this 
study their only necessary characteristic was that of 
providing a diverse group of scores on the Gordon 
Personal Profile and reasonable diversity in response 
to questions 


about products 


Test Materials 


The Gordon Personal Profile was selected as the 
personality test to use since it measures four charac- 
teristics which seem intuitively meaningful as com 
ponents of the “normal” personality and since it is 
based on college student norms. The profile rates per 
sons on the variables of ascendency, responsibility, 
emotional stability, and sociability 

The form used to determine use of products or 
other marketing included nine qu 
tions relevant to the experiments and blind 
Most of the experimental 
ferred to frequency of use of a particular product, 
as in the following: 


characteristics 
seven 


questions questions re- 


How frequently do you experience a headache that 
requires a headache remedy (aspirin, Bufferin, 
Anacin, etc.) 
Never 
Once or twice a year 
About once a month 
More often than once 
once a week 
Once a week or more 


a month, but less than 


Questions of this sort were asked about the use of 
headache remedies, vitamins, chewing gum, tobacco, 
mouthwash, alcoholic beverages, and deodorants. Two 
other questions related to the readiness with which 
the individual accepted new styles or fashions and 
preference in automobiles 

Blind questions were rather similar to those asked 
on interest tests: 


Which of the following positions in an organiza- 
tion would you prefer to hold? 

a. Secretary-Treasurer 

b. Program chairman 

c. President 
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d. Membership chairman 
e. Ordinary member, no office 


The list of 16 questions was pretested in order to 
insure their clearness and to make sure that multiple 
choice answers would elicit a reasonable spread of re- 
sponse. As a result of this pretesting, multiple choice 
answers were altered to fit the normal variations in 
frequency of use of various products. For instance, 
the most frequent use of headache remedies indi- 
cated by answers was “once a week or more,” while 
the most frequent use of deodorants was described 
as “more than once a day,” since the pretest demon 
strated these to be common frequencies for 
users 


heavy 


Procedure 


Subjects filled out both forms at a single sitting of 
about 20 minutes, Gordon Personal 
Profile first and the Sales and Marketing Personality 
Index second. While subjects were asked to fill in 
their sex, age, marital status, and year in school on 
the Gordon Personal Profile, names were not taken 
in order to encourage the greatest frankness in 
sponse. Each pair of tests handed out was numbered 
in advance 


answering the 


Instructions to Subjects 


Students in each class tested were given the follow 
ing instructions 


As you all know, one of the difficult problems 

business is the determination of an individual's in 
terests, or what kind of job he can do best. At 
tempts to solve such problems have led to the de- 
velopment of a number of written tests—some of 
which take an hour or more to complete. You 
have in front of you two rather new tests that try 
to accomplish this for certain marketing jobs in 
just a few minutes. We know that one of these is 
moderately successful. We are interested in whether 
scores on the other are different or much the same 
Do these tests really measure the same things? 


To determine this, we need your help. We are not 
interested in your score as an individual but in the 
relationship of your score on one test with your 
score on the other 


For that reason, we do not want your name on the 
paper; we merely want you to answer the ques 
tions honestly and conscientiously. Instructions for 
each test appear at the top of the test 


First, make sure the red number on each of vour 
tests is the same. Then fill in your age, sex, marital 
status, and year in school on Test #1, the Gordon 
Personal Profile. Then read the instructions on that 
test and answer the questions. When you are fin- 
ished, go directly to the second test, read the in 
structions, then answer the questions 

You will find that on both tests there are 
questions where none of the answers 
right for you 


some 
seem just 
Just pick the one that seems closest 
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TABLE 1 
MEAN RESPONSIBILITY SCORES FOR 


DIFFERENT 


GROUPS WITH 


PATTERNS OF UsE oF MovuTHWASH 


Mear 


Score 


Number 
Response of Cases 
7.26 31 


Quite infrequently 40) 


Never use mouthwash 


Once or twice a week 
Once a day 
More than once a day 


Remember 
instructions carefully, since you 
a somewhat different 


ind do not worry about exact wording 
to read the test 
have to answer each test in 
way 


Analytic Method 


Results were analyzed by comparing the difference 
in mean scores on one personality characteristic for 
groups with different product use patterns 

Table 1 shows the mean scores on responsibility for 
groups which answered the mouthwash question in 
each of the possible ways. 

While responsibility seems to be inversely related 
to frequency of use of mouthwash, despite relatively 
high four who use mouth- 
wash more than once a day, the number of cases in 
some of the cells is too small for analysis of variance 
to show a relationship. For this reason, 
the last four groups were combined and compared 
using the ¢ test with those who reported never using 
mouthwash. The resulting ¢ of 2.12 is significant at 
the .05 level. The F test for homogeneity of variance 
was not significant 

This same method of 


scores for the persons 


significant 


analysis was used for each 
of the products on each of the personality charac- 
teristics, with the point for division into two groups 
being determined on the basis of scores and the num- 
ber of subjects remaining in each of the groups 

It is entirely proper to question whether five-point 
scales of the sort used here should be dichotomized 
after observing the means of each of the categories. 
Such dichotomization obviously makes it possible to 
maximize the number of “significant” relationships 
Where possible, it should therefore be avoided and 
ome independent method should be used for di- 
chotomization 

Since there is no apparent rationale for predicting 
relationships between personality characteristics and 
product use, it seems foolhardy to develop a purely 
arbitrary dichotomization method in the present case. 
Such a method could easily minimize relationships 
if it were only extremes of product use that related 
to personality measures and the cutting point closest 
to the median arbitrarily used, for instance. 
It happens that dichotomizing the data shown in 
Table 1 by combining the top two categories and 
the bottom three does not lead to a significant t. The 


were 


resulting quandary is more philosophical than statisti 
cal. It seems to the authors that refusing to locate 
the cutting point that leads to statistically significant 
differences is the more serious error when dealing 
with the kind of problem discussed here 


RESULTS AND DISCUSSION 


A total of 36 
categories 


comparisons (9 product 
4 personality characteristics) in- 
cluded 13 significant relationships. As might 
be expected, some products were associated 
with no personality trait; others were associ- 
ated with one or more; and one product, vita- 
mins, was associated with all four of the per- 
sonality traits. 

Table 2 shows those relationships indicat- 
ing the significance level. In addition it shows 
correlation ratios in parentheses to indicate 
the approximate strength of the relationships 

The results clearly indicate that there is a 
relationship between product use and person- 
ality traits. This relationship apparently may 
include both frequency of use of a particu- 
lar product and preference among different 
brands of a single product, since preference in 
automobiles is significantly related to scores 
on responsibility. At the same time, some 
products are used frequently or infrequently 
without relationship to any of the personality 
traits tested. Each personality trait seems to 
bear a relationship to the use of some prod- 
ucts, each of the four traits scored by the 
Gordon Personal Profile relating to the use of 
at least two of the products considered in the 
present experiment. 

It should be pointed out, however, that the 
relationships located between product use and 
personality are not particularly strong, cer- 
tainly less strong than popular marketing con 
cepts of the day suggest. 

An obvious corollary to the conclusion that 
personality traits and product use are related 
is that the Gordon Personal Profile does iso- 
late personality traits related to behavioral 
differences. Further, an examination of the 
pattern of significant relationships shown in 
Table 2 is persuasive that the four traits, 
ascendency, responsibility, emotional stability, 
and sociability, have considerable independ- 
ence. The manual for the test indicates that 
the intercorrelations are generally low except 
for those between ascendency and sociability 
(.43) and between emotional stability and re- 
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TABLE 2 


SIGNIFICANT PERSONALITY TRAITS IN THI 


\scendency 


Headache remedies 
Acceptance of new fashions 
Vitamins 


Cigarettes 
Mouthwash 


Alcoholic drinks 


Deodorants 


Automobiles* 


Chewing gun 


Note 


to infrequent use of headache re 


In all cases except f 
* Subjects who preferred the n 
the responsibility scale thar 
significant ¢ 

ffered it by someone else, are significant] 
Correlation ratios 


higher or 
While there is no 


wher 


sponsibility (.46). Those correlations were 
considerably higher in the present experiment 
as shown in Table 3. The remaining correla- 
tions are quite low. It must be concluded that 
the Gordon Personal Profile does not meas- 
ure four independent characteristics but two 
independent sets of related characteristics. 
However, it seems that one of a set of related 
characteristics can still prove to have enough 
relative independence to be conceptually 
valuable 

Most of the significant relationships be- 
tween product use and character traits located 
are intuitively acceptable. One would expect 
that high ascendency and high sociability 
would be related to the rapid acceptance of 


TABLE 3 


INTERCORRELATIONS AMONG PERSONALITY TRAITS 


Asi en 


ency sibility Stability 


Respor Emotional 


Traits 
Responsibility 058 


Emotional Stability 035 


Sociability 708 


UsE OR PREFERENCI 


indicates 
apid a 
1 as Buick, 
preference 


ore 


SoME CONSUMER PRODUCTS 


FOR 


Emotional 
Stability 


Responsi 


bility Sociability 


281 
05 
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the nature of the relationsh 
ceptance of new fashions 
Dodge, Mercury, For 


for such spor ars 
A 


new fashions, especially since ascendency is 
described largely as social leadership. On the 
other hand there seems to be no particular 
reason for expecting all personality character- 
istics to be associated with the frequency of 
use of vitamins, unless one conceives that pe! 
sonality traits are most likely to affect behav 
ior that society neither rewards nor punishes 

The results cast some possible light on the 
nature of responsibility as a character trait. 
It is related to vitamins and 
mouthwash, preference for popular cars and 
moderate drinking or abstinence. Since these 
are all modal characteristics of the group be- 
ing tested, a reasonably strong case might be 
made for the fact that responsibility is closely 


avoidance of 


related to the acceptance of group norms. 

A comparison of the present results with 
those of Eysenck (1960) suggests that 
ciability on the Gordon Personal Profile is 
considerably different from extroversion, with 
which it might seem related. Eysenck’s results 
showed a significant correlation be- 
tween extroversion and heavy cigarette smok- 


SoO- 


strong, 


ing, while the present experiment did not even 
hint at such a relationship between sociability 
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and heavy smoking. It is possible that the dif- 
ference in age (Eysenck’s subjects were con- 
siderably older) or difference in nationality 
(Eysenck’s subjects were British) might ex- 
plain this apparent contradiction 


SUMMARY 


The answers to the Gordon Personal Profile 
and a disguised product use questionnaire by 
101 college of business students demonstrate 
that personality traits are often related to 
product use. Thirteen of a possible 36 such 
relations were significant at the .05 level or 
above. 

\ corollary conclusion is that the Gordon 


' 
329 


Persona! Profile distinguishes personality traits 
related to behavioral differences, although the 
four traits are not “independent.” 
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FACTOR ANALYTIC DEFINITIONS OF 


VOCATIONAL 


MOTIVATION 


JOHN O. CRITES! 


State University of lowa 


Reflecting the increasing emphasis during 
the past decade upon the role of dynamic 
factors in occupational choice and vocational 
adjustment (Ginzberg, Ginsburg, Axelrad, & 
Herma, 1951; Roe, 1956), recent research 
on the measurement of vocational phenomena 
deals largely with the construction of instru- 
ments designed to assess such motivational 
variables as preferences for different occupa- 
tional activities and situations, evaluations of 
the desirability of various job components, 
and judgments about the relative appeal of 
tangible and intangible work incentives. 
Among the new measures of vocational moti- 
vation are the Occupational Attitude Rating 
Scales (OARS) developed by Hammond 
(1954, 1956, 1959), the Work Satisfaction 
Questionnaire (WSQ) devised by Astin 
(1958), and the Job Incentive Rankings 
(JIR) constructed by Bendig and Stillman 
(1958). Based upon factor and cluster analy- 
ses of item ratings and rankings, these self- 
report questionnaires yield scores on 11 voca- 
tional motivation scales: Materialistic, 
Competitive, Technical, and Humanitarian 
(OARS); Managerial-Aggressive, Status- 
Need, Organization-Need, and Working Con- 
ditions* (WSQ); and, Achievement-Need, 
Intrinsic Job Interest, and Job Autonomy 
(JIR). Within the three inventories, due to 
their factorial composition, scores on one 
scale are essentially independent of those on 
another, the highest correlation being .28 
for the Materialistic and Competitive scales 
of the OARS (Hammond, 1956). 

The intercorrelations of the scales from the 
various inventories are unknown, but it seems 
reasonable that they are related and define 


‘The author wishes to express his appreciation 


to Harold P. Bechtoldt for his generous assistance 
in processing and analyzing the data 

2 Although Astin (1958) assigns no name to the 
item cluster which constitutes this scale, ior con- 
venience in discussion it is called “Working Con- 
ditions.” 


similar variables. Both Hammond (1956) 
and Astin (1958) found differences between 
college major groups on the OARS and WSQ 
which indicate possible relationships between 
the scales of these questionnaires. For ex- 
ample, the Materialistic (OARS) and Mana- 
gerial-Aggressive (WSQ) scales differentiate 
business students from those in other cur- 
ricula, and the Technical (OARS) and Or- 
ganization-Need (WSQ) scales distinguish 
between science and nonscience majors. 
Bendig and Stillman (1958) report no group 
comparisons, but the item content of the 
JIR scales suggests that they measure atti- 
tudes much like those assessed by the OARS 
and WSQ. To illustrate, the Materialistic 
(OARS) and Job Autonomy (JIR) scales 
contain almost identical items (“economic 
security” and “good job security”), and the 
Managerial-Aggressive (WSQ) and Achieve- 
ment-Need (JIR) scales express quite similar 
preferences and values (“A job where I do 
not work under instructions” and “Freedom 
to assume responsibility”). There is some 
evidence, then, that the scales of the newly 
developed vocational motivation inventories 
are not independent and that they cluster 
into distinguishable groups. 

The purpose of the present study was to 
test for the existence of interrelationships 
among the OARS, WSQ, and JIR scales and 
to identify the groups which the scales form. 
More specifically, the objective was to reduce 
the number of scales to a more parsimonious 
set and to provide factor analytic definitions 
of the dimensions of vocational motivation 
The anticipated outcomes of the analysis 
were a Clarification of the structure of voca- 
tional motives, an evaluation of the compo- 
sition of the inventory scales, and a basis for 
the integration of theoretical constructs. 


PROCEDURE 


Measuring In 
Rating 


truments 


The Occupational Atti 


tude Scales contain 40 items, 10 for each 
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of four scales, which a subject rates on a five-point 
scale. The scale extends from “much liked,” through 
“indifferent,” to “much disliked.” The scores for 
the scales are the unweighted totals of keyed items. 
Internal consistency estimates for the scales range 
from .66 (Materialistic) to .80 (Humanitarian) 
Hammond, 1956). The Work Satisfaction Question- 
naire has 19 statements about different kinds of 
work which a subject rates on a seven-point scale 
of desirability. Scale scores are the sums of the 
ratings. Astin (1958) reports no reliability data for 
the scales of the questionnaire. The Job Incentive 
Rankings are made with 8 verbal descriptions of 
job incentives, which the subject orders according 
to their importance to him in choosing an occupa- 
tion. Scores are obtained by subtracting the ranks 
of pairs of job incentives which define the three 
scales. Bendig and Stillman (1958) present no find- 
ings on the reliability of the rankings 
Subjects. The sample consisted of 30¢ 
in a large undergraduate, introductory course in 
psychology. All subjects had at least sophomore 
standing. They took the OARS, WSQ, and 
JIR voluntarily as part of the course and received 
additional credit for participating in the test ad- 
ministration. In the sample there were equal num- 
bers of males and females. Because preliminary 
analysis of the data indicated possible sex differ- 
ences in intertest relationships, the male and female 
variance-covariance matrices were compared for 
heterogeneity. The findings (t= .72, df=131, p> 
05) supported the homogeneity of the 
however, and males and females 


subjects 


class 


matrices, 


were <¢ ombined 


for the factor proper, which wa 
upon the entire sample of 300 subjects 

Method. The 11 variables for the OARS, WSO 
and JIR were intercorrelated by the usual product 
moment techniques, and the resulting matrix of 55 
coefficients was analyzed by the complete 
centroid method, after the hypothesis of inde- 
pendence among the inventory scales was rejected 
(R. Bargmann, 1957 unpublished). Four factors were 
iterated through two cycles by Bargmann’s pro- 
cedure, and (1951) maximum likelihood 
test of the independence of residual covariances was 
applied to determine whether 
factors remained 


analysis 


lactor 


Lawley’s 


additional 
Since the test was significant (. 
= 23.49, df=10, p< .01), one more iteration was 
made, and nonsignificant residuals which ranged from 
— .048 to .046 were obtained. With analytic (obli 
max) and graphical methods, the resulting five 

tors were then rotated to an orthogonal simple stru 
ture solution 


common 
2 


RESULTS 


Table 1 presents the _ intercorrelation 
matrix for the OARS, WSQ, and JIR scales, 
as well as the means and standard deviations 
for each variable. As compared with total 
possible score ranges, and in ratio to the 
means, the standard deviations for the scales 
indicate adequate variability for the purposes 
of correlational and factorial analyses. From 
inspections of the score distributions for all 


TABLE 1 


INTERCORRELATIONS OF OCCUPATIONAL 
QUESTIONNAIRE 


MALES 


Variables 


OARS 
1. Materialistic 
2. Competitive 
3. Technical 
4. Humanitarian 
WSO 
5. Managerial- 
Aggressive 
6. Status-Need 
7. Organization- Need 
8. Working Conditions 
JIR 
9. Achievement- Need 
10. Intrinsic Job Interest 
11. Job Autonomy 


Note Decimal points omitted for correlat efficients 


ATTITUDE RATING SCALES 
WSQ), AnD Jos INCENTIVE RANKINGS (JIR 


OARS), Work 
VARIABI 


AND FEMALES COMBINED 


At .05 level: 
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rABLE 2 


ACTOR LOADIN \TTITUDE 


WSQ AND J 


Ss OF OCCUPATIONAI 


Qt ESTIONNAIRI 


Vv 


OARS 
Materialistic 
. Competitive 
. Technica] 
. Humanitariar 
Manageria!-Aggressive 
Status-Need 
Organization- 
8. Working C 
JIR: 
9. Achievement-Need 
10. Intrinsic Job Interest 
11. Job Autonom) 


W ~d 
Veet 


onditions 


scales and the scatterplots of five randomly 
selected pairs of scales, the assumptions of 
normality and linearity of regression seem 
tenable. 

Table 2 lists the rotated factor loadings 
and communalities for the 11 variables. Fac- 
tors A and B have both positive and negative 
loadings of sufficient magnitude to make 
them bipolar. The highest absolute loadings 


+A 
MATERIAL 
Security >— 


j 1068 
| AUTONOMY 
_- JIR) 
Jos ¢ es : 
FREEDOM a \ 
_L| structure 
/ WORKING 
/ MANAGERIAL | CONDITIONS 
4 AGGRESSIVE d 
2 f = a (wsc) 
~\_ (WSQ) x ~ #2 
/ y oo 4B 
ORGANIZATION . 
{ ¢ 7 
| SQ \ 
| SOCIAL D \ 
APPROVAL SYSTEM 
} 


PERSONAL STATUS 


MUMANITARIAN | _ il i 
(OARS) / 
A, 


-B / 


— SOCIAL SERVICE 
ET 


Vocational motivation factors 


RATING ScALES (OARS), Work SATISFACTION 
B INCENTIVE 


RANKINGS (JIR) VARIABLES 


= 300 


Rotated Factors 


are on Factors C and D and the lowest on 
Factors B and E, with Factor A intermedi- 
ate. Six of the scales (Materialistic, Competi- 
tive, Technical, Status-Need, Achievement- 
Need, and Intrinsic Job Interest) load on 
only one factor, whereas the other five (Hu- 
manitarian, Managerial-Aggressive, Organi- 
zation-Need, Working Conditions, and Job 
Autonomy) relate to two or more factors. 
With the exception of the negative pole of 
Factor B, as defined by the Humanitarian 
scale, the factors are composites, being 
formed by combinations of two or more 
scales. 

Figure 1 presents graphically the various 
factors and some of the scales which load on 
two or more of them. The scales which corre- 
late with only one factor are not shown, in 
order to simplify the diagram, but they 
would be within the larger circles. The circles 
depict the total variance in a factor or scale, 
and the amount of overlap between circles 
represents the approximate percentage of 
common variance. The connected circles for 
Factors A and B indicate that they are bi- 
polar. Factor D is superimposed upon Factor 
B, but the two factors are actually inde- 
pendent. 
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DISCUSSION 
To facilitate the interpretation of the re- 
sults and to make explicit the bases for 
inferences about the meaning of the factors 
refer to Figure 1 and Table 3. In the latter 
the columns (factors) and (scales ) 
correspond to those in Table 2, but the 


TOWS 


entries are the items from the various voca- 


tional motivation scales. For a given scale, 


TABLE 


IremMs CLASSIFIE 


OARS, WSQ, An! 


» JIR Scat 


items were classified according to the factors 
which they seemed to define. Thus, reading 
down a column provides a summary of the 
item content for a factor and suggests some 
hypotheses about the variable it measures. 

The factors were named, as much as pos- 
sible, to indicate the dimension of vocational 
motivation they define, instead of the type 
of work which satisfies a particular need or 
value. Three general dimensions, each with 
3 


MorTIvATION Fac 


D BY VOCATIONA 
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TABLE 3—(Continued) 


A. Material 
Security vs. Job 


Freedom 


B. Personal Status 
vs. Social Service 


(Negative) 


5. Managerial 


Aggressive A job where I do 
not work under 
instructions 

Work where the 
duties change 


frequent 


High salary 
Live in large city 


Positive) 
\ job where I work 


8. Working Cond 
‘ all of the 


yns indoors 
time 

A job with no phys 

ical activity 

Live in large city 


Note 


hich keeps me busy all of the t 


—The Managerial 


specific aspects, emerged. As discussed be- 
low, these were security, status, and service: 


Factor A—Material Security vs. Job Free- 
dom. The loadings of the so-called Job 
Autonomy (JIR) scale and the Materialistic 
(OARS) scale define the positive pole of this 
factor as a motivation for the extrinsic re- 


Factors 


C. Social Appro\ 
Directing, controlling, Work which kee 
and planning activi me very bu all 
ties ol others yt the tt 
Work where I in 

fluence opinions 

and attitudes of 

others 
\ job where I work 

under stress 
A job where I ex 

press my personal 


“ling 


Working closely 


with 


Work which kee 


me very bus 


Make judgments 


along 
others according to 


Working with peop! measurable of the time 


who have similar standards \ job where 


interests \ job where I work must 
nust attain ex- performed 
cording to a set 


tir hedule 


act standards 


Work where the 
duties do 
change fre 


quent 
qu 


wards rather than the intrinsic satisfactions 
of work. The emphasis in the negative pole is 
upon those aspects of the Achievement-Need 
(JIR) and Managerial-Aggressive (WSQ) 
scales which pertain to freedom in work, par- 
ticularly as expressed in varied job duties 
and minimal supervision. The two poles of 
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this factor closely correspond to the extrinsic 
and intrinsic sources of job satisfaction sug- 
gested by Ginzberg et al. (1951). 

Factor B—Personal Status vs. Social Serv- 
ice. The positive pole of this factor, as de- 
fined by the Status-Need (WSQ) and Work- 
ing Conditions (WSQ) scales, reflects an 
egocentric need for the status which comes 
from a highly remunerative, prestigeful, 
white collar job. Unlike the status acquired 
through the admiration and acceptance of 
others, which Factor C (Social Approval) 
assesses, the essence of the need for personal 
status is affluence rather than influence. The 
negative pole is the familiar “helping others”’ 
motivation, but always on an intimate, per- 
sonal level, not through otganized activities 
and large-scale programs. Evidently, there are 
two distinct modes for the expression of 
humanitarian motives: one is in face-to-face 
individual relationships, and the other is 
through group enterprises, as in Factor C 
(Social Approval). 

Factor C—Social Approval. Unidentified 
in previous work, but intriguing as a dimen- 
sion of vocational motivation, this factor ap- 
pears to represent a fusion of attitudes in- 
herent in the Protestant Ethic and American 
Capitalism (Whyte, 1956). It reflects the 
appeal of those social rewards, e.g., recog- 
nition as a leader and community servant, 
which stem from the initiation and imple- 
mentation of political and service programs 
through aggressive executive action. The 
prototype of the person motivated by ‘“so- 
cial approval,” perhaps because of guilt feel- 
ings about his material well-being, is the 
successful businessman who organizes chari- 
ties and establishes funds in the public in- 
terest. 

Factor D—System. Best defined by the 
Technical (OARS) scale, which encompasses 
the aspects of precision and skill contributed 
by the Organization-Need (WSQ) and 
Achievement-Need (JIR) scales, this factor 
was named “System” to identify its main 
characteristics: order, planfulness, detail, 
perfectionism, and impersonality. These char- 
acteristics define an orientation which con- 
trasts sharply with that reflected in Factor 
E (Structure). The difference is much like 
that which exists between the “methodical” 


man and the “mechanical” man: one creates 
plans, and the other carries them out. 

Factor E—Structure. Other designations, 
such as “Organizational Security,” which 
emphasize the importance of duties and tasks, 
routines, and schedules as means of anxiety 
reduction (Kates, 1950), also capture the 
meaning of the scales that form this factor. 
In this instance, as contrasted with Factor 
A (Material Security), the formality of an 
impersonal organizational structure, rather 
than the accumulation of worldly goods, 
serves to provide a source of security. 

These interpretations of the factors are 
necessarily only suggestive and tentative, but 
they seem meaningful and provide hypotheses 
for further research. 

With.respect to the OARS, WSQ, and JIR 
scales, their intercorrelations and factorial 
loadings provide some insight into both their 
composition and potential usefulness: 

1. Occupational Attitude Rating 
The Materialistic and Technical scales are 
factorially pure and measure what their 
names imply, although they might better be 
identified by more psychological and motiva- 
tional terms, such as the needs for “Material 
Security” and “System.” The Competitive 
scale is also factorially simple, but it seems 
to measure less a need for “Personal Status,” 
as Hammond (1956) suggests, than a need 
for “social status,” as indicated by its load- 
ing on Factor C (Social Approval). Unlike 
the others, the Humanitarian scale is factori- 
ally complex: one part pertains to assisting 
people through empathic understanding, the 
other represents helping them through group 
action. 

2. Work Satisfaction Questionnaire. With 
the exception of the Status-Need scale, which 
assesses a desire for prestige and self-ag 
grandizement, the scales in this inventory 
are nonspecific and nonunitary. The Mana- 
gerial-Aggressive scale breaks down into three 
distinct parts—job freedom and variety, con- 
trolling and directing, and rapid work pace 
which support the appropriateness of its 
name. Similarly, the Organization-Need scale 
subdivides into various components, but only 
the items which load on Factor E (Structure 
are consistent with the scale’s title. The 
Working Conditions which Astin 


Scales 


scale, 
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(1958) refrained from naming, assesses es- 
sentially what its title connotes and has suffi- 
cient promise to recommend its use in fur- 
ther research. 

3. Job Incentive Rankings. The incentive 
rankings have two major shortcomings. First, 
the names of the scales are largely inap- 
propriate t® express what they measure. The 
Achievement-Need scale pertains more to job 
autonomy than to “getting ahead.” Likewise, 
the Intrinsic Job Interest scale concerns con- 
comitant work satisfactions rather than satis- 
factions derived from the work per se. Also, 
the Job Autonomy scale measures security 
needs, not the desire for freedom in work. 
And, second, the scales are too restricted in 
their coverage of the vocational motivation 
domain. They are not comprehensive enough 
to represent more than one or possibly two 
of the seven factors derived from the analy- 
sis. Probably the best set of scales to define 
all of the factors, for both males and females, 
since there are no sex differences, is the fol- 
lowing: Factor A—Materialistic (OARS) 
and Achievement-Need (JIR), Factor B— 
Status-Need (WSQ) and Humaniatrian 
(OARS), Factor C—Managerial-Aggressive- 
(WSQ), Factor D—Technical (OARS), and 
Factor E—Organization-Need (WSQ). 

As far as theories of vocational motivation 
are concerned, they propose various drives, 
instincts, and needs as in explaining 
why individuals make differential choices of 
occupations and seek dissimilar satisfactions 
in work. Among the energizing states and 
conditions which supposedly elicit and pro- 
duce individual differences in vocational be- 
havior are the and destructive 
drives (Menninger, 1942), the mastery in- 
stinct (Hendrick, 1943a, 1943b), the work 
and pleasure orientations (Ginzberg et al., 
1951), and the physiological and self-actuali- 
zation needs (Roe, 1956). To assess the value 
of these constructs as definitions of independ- 
ent dimensions of vocational motivation it is 
necessary to translate them into operational 
terms and to determine their interrelation- 
ships. The OARS, WSQ, and JIR scales meas- 
ure a number of the variables specified in the 
theories, and their intercorrelations and fac- 
torial loadings reveal the extent to which 
the variables covary. The findings agree with 
the use of several theoretical 


basic 


aggressive 


constructs to 


John O. Crites 


account for individual differences in voca- 
tional motivation: there is no one general 
vocational motivation factor. More specifi- 
cally, they suggest that the needs for se- 
curity, status, and service are unique voca- 
tional motives and that Ginzberg’s theory of 
extrinsic, concomitant, and intrinsic work 
satisfactions is the most meaningful one as a 
frame of reference for these concepts. 

In further research on the factors as defi- 
nitions of vocational motivation, one of the 
most important problems concerns the dem- 
onstration of their construct validity. The 
present study establishes the factors as 
unique variables, and suggests hypotheses 
about their meaning, but it offers no inde- 
pendent evidence of what they measure. Two 
kinds of additional studies are needed: one 
on the relationship of the factors to nontest 
indices of motivation, and the other on the 
possible drive properties of the factors, such 
as their efficacy in the facilitation of a wide 
variety of responses and in the learning of 
new responses (Brown, 1961). Once there 
is support for the factors as measures of 
motivation, rather than habits or response 
tendencies, research on their relationships to 
vocational interests (Darley & MHagenah, 
occupational membership (Roe, 
1956), and job satisfaction (Ginzberg et al., 
1951) will be possible. 


1955), 


SUMMARY 


Recent theoretical emphases upon the re- 
lationship of motivational variables to occu- 
pational choice and vocational adjustment 
have resulted in the development of several 
instruments designed to measure such voca- 
tional motives as competition, achievement, 
and independence. Since the various scales of 
these newly constructed questionnaires and 
inventories either differentiate similar educa- 
tional and vocational groups or have com- 
parable item content, relationships among 
them are suggested. The present study was 
designed to test for the existence of these 
interscale relationships and to formulate fac- 
tor analytic definitions of vocational motives. 

From an_ 11-variable _ intercorrelation 
matrix based upon test data for 300 subjects 
(150 males and 150 females), five factors 
were extracted, following the complete 


centroid method. After rotation, the factors 
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were identified as follows: A—Material Se- 
curity vs. Job Freedom, B-—Personal Status 
vs. Social Service, C—Social Approval, D— 
System, and E—Structure. These factors ap- 
peared to provide a comprehensive survey of 
the dimensions of vocational motivation usu- 
ally mentioned in theories of occupational 
choice and vocational adjustment. Intrepreta- 
tions of the factors were made, and the im- 
plications of the findings for theory construc- 
tion were discussed. Some possible problems 
for future research on the construct validity 
of the factors and their relationships to other 
vocational variables were outlined. 
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INDIVIDUAL AND GROUP CORRELATES OF ATTITUDES 
TOWARD WORK-RELATED CHANGE’ 


DON A. TRUMBO 


Kansas State University 


This report is one in a series describing a 
set of studies on technological change. An 
earlier report (Jacobson, Trumbo, Cheek, & 
Nangle, 1959) described the research setting, 
sample, and data gathering procedures and 
presented selected findings regarding em- 
ployee perceptions of and attitudes toward a 
specific technological change event. 

In the present study, individual and group 
correlates of attitudes toward change were 
explored for the purpose of refining a number 
of hypotheses regarding those factors which 
condition employees attitudes toward work- 
related change. The term “work-related 
change” serves to distinguish the more gen- 
eral attitude object of the present study from 
the specific change event, reactions to which 
were described in the initial report. 

Prior research on response to industrial 
change has focused on the work group as the 
unit of study. Resistance to change has been 
defined in terms of group performance meas- 
ures and turnover rates (Bavelas, 1947; 
Coch & French, 1948). The effectiveness of 
“group participation” methods of adminis- 
tering change, as indicated in the results of 
these studies, strongly suggests that the lead- 
ership attitudes and behavior of the super- 
visor, in his role as change agent, may con- 
dition group attitudes toward change. 

While these studies provide insight into 
the factors which facilitate the acceptance of 
specific change events, no research known to 
this writer has systematically investigated 
the attitudes of employees toward change as 


1This paper is based on portions of the writer’s 


doctoral dissertation (Trumbo, 1958). The writer 
wishes to acknowledge the guidance and assistance 
of James S. Karslake, major professor, and of 
Eugene Jacobson, Milton Rokeach, and Donald M. 
Johnson. This study was conducted as one of a 
series of projects on technological change supported 
by the Labor and Industrial Relations Center, 
Michigan State University, under the research di- 
rectorship of Jack Stieber. Jacobson served as 
project director. 


a general work-related phenomenon. Neither 
correlates of individual change attitudes nor 
situational factors asociated with differences 
among attitudes in work groups have been 
identified. 

In the present study it was assumed that 
attitudes toward change could be meaning- 
fully related to personal data items and other 
indices of employee needs and abilities, and 
that from these relationships more specific 
hypotheses about the underlying need struc- 
ture and conditioners of change attitude 
could be derived. It was also assumed that 
the social psychological climate of the work 
group, as reflected in measures of supervisor's 
attitudes and group cohesiveness, conditions 
the change attitudes of the group. 

At the level of the individual employee, 
the following general hypotheses were stated: 


Attitudes toward change are positively re- 
lated to the job investment of the employee. 
Job investment was defined in terms of the 
employee’s identification with the work force, 
the economic need for the job, and length of 
service with the company. In addition both 
age and sex of the employee were felt to be 
indicative of differences in job investment, 
with the older employees having a greater 
investment than younger employees and men 
having a greater investment than women. 
Therefore, the personal data items of age, 
sex, length of service, and a job involvement 
(JI) index were considered together as in- 
dices of job investment. The prediction of a 
positive relationship between these items and 
attitudes toward change was based on the 
assumption that job changes necessitate re- 
adjustments which would have more negative 
valence for the employees with little job 
investment than for those with a greater in- 
vestment in their jobs. 

Secondly, it was hypothesized that atti- 
tudes toward change are positively related 
to the capacity for adjustment to change 
Capacity for adjustment was defined in terms 
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of general ability, amount of formal educa- 
tion, and freedom from job anxiety. 

At the work group level, relationships were 
predicted between three measures of super- 
visory attitudes and group attitudes toward 
change. In view of the supervisor’s role as 
administrator of change and in light of the 
evidence for the effectiveness of group par- 
ticipation methods of administering change, 
positive relationships were predicted (a) be- 
tween the change attitudes of the supervisor 
and group attitudes toward change, and (bd) 
between the human relations attitudes of the 
supervisor and the change attitudes of the 
group. Prior research also provided a rationale 
for predicting a negative relationship between 
the authoritarianism of the supervisor and 
group change scores. 

Finally, reasoning that change may present 
a threat to the satisfaction and security ob- 
tained in cohesive work groups, it was pre- 
dicted that cohesiveness would be negatively 
related to attitudes toward change in the 
work group. 

Since there is little in the way of formal] 
theory regarding the phenomenology of work- 
related change, these predictions were tenta- 
tive and the study largely an exploratory 
one. 

PROCEDURES 


Data were obtained from questionnaires and 
from the personnel files on 46 supervisory and 
232 nonsupervisory personnel, approximately 85% 
of the home office staff of an insurance company 
engaged in “office automation” changes. Of the non- 
supervisory sample, 79% were women; the median 
age was 30 years (interquartile range: 23 to 42 
years), and the median length of service was 15 
months. Eighty-two percent were high school gradu- 
ates, and an additional 10% were college graduates. 
A more detailed description of the sample, the 
questionnaires, and data collection procedures is 
available in the previous report (Jacobson et al., 
1959) and need not be repeated here 

The Change Scale. The major index of employee 
attitudes toward work-related change consisted of 
the following nine Likert-type items from the ques- 
tionnaire: 


1. The job that you would consider ideal for 
you would be one where the way you do your 
work: (five choices from “is always the same” 
to “change a great deal”). 


Each of the remaining eight items had five alterna- 
tives from “I strongly agree,” to “I 
gree.” 


strongly disa- 


2. If I could do as I pleased, I woud change 
the kind of work I do every fe'v mor ths. 

3. One can never feel at ease on a ‘ob where 
the ways of doing things are alwi.ys being 
changed. 

4. The trouble with most jobs is thai you just 
get used to doing things in one way and then 
they want you to do them differently. 

5. I would prefer to stay with a job that I 
know I can handle than to change to one where 
most things would be new to me 

6. The trouble with many people is that when 
they find a job they can do well, they don’t 
stick with it. 

7. I like a job where I know that I will be 
doing my work about the same way from one 
week to the next. 

8. When I get used to 
way it is disturbing to 
new method 

9. It would take a sizeable raise in pay to get 
me to voluntarily transfer to another job 


things in one 
change to a 


doing 
have to 


Responses to these items serially 
from 1 to 5 with high item scores indicating favor 
able change attitudes. Summated 
11 to 45 with a mean of 28.03 (¢ = 6.64 
groups (V,=— WN 61) 
distribution vik Ided 


were coded 
cores ranged fron 
Compari 
from the composite score 
values from 3.5 to 13.5 with 
a median t = 12.1 (p All items 
were monotonically related to total scores. The cor 
rected odd-even reliability coefficient was Hence 
the items met the criteria for a Likert scale and wert 
labeled the Change Scale 

While the Change Scale had face validity as a 
measure of generalized attitudes change 
evidence of logical validity was sought in a com 
parison of scale scores with responses to questions 
about specific past, current, and anticipated future 
change events. If the scale were a valid measure 
of attitudes toward change, high scores would be 
associated with favorable responses when much 
change was perceived and unfavorable responses 
when little or no change was perceived. Conversely, 
low Change Scale would be predictive of 
unfavorable responses when much change was per 
ceived and favorable little or no 
change was perceived 

Four pairs of Likert-type items in the question 
naires permitted a test of predictions. The 
first item in each pair indicated the amount of 
change perceived (“Have machines changed the 
nature of your job in the past two years?” “What 
effect did the change-over [to the new computer 
have on your job?” “In general, how much change 
takes place from time to time in the way you do 
your present job?” and “Do you think the computer 
will affect your job in the next year or two?”) 
Each of these items was followed by the same five- 
choice item: “How do (did) you feel about this?” 
Alternatives to this item ranged from “like it very 
much” to “dislike it very much.” 

Employees were dichotomized into “high change” 
and “low change” groups on the basis of responses 


01 for each item 


toward 


scores 


responses when 


these 
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to the first item in each pair. These groups were 
then subdivided into “like” (L), “indifferent” (I), 
and “dislike” (D) categories by their responses to 
the second item in each pair. Differences among 
the mean Change Scale scores for the L, I, and 
D subgroups of the “high change” employees were 
significant and in the predicted direction for each 
of the four items. For “low change” employees, 
the differences were consistently in the predicted di- 
rection, but significant for one item only. 

These comparisons indicate that Change Scale 
scores were predictive of attitudes toward specific 
change situations, particularly when the employee 
perceived or anticipated relatively extensive changes 
in his own job 

Job investment. Data on length of service, age, 
and sex were obtained from the questionnaires and 
from the personnel files. The JI index was a com- 
posite score based on two questionnaire items 
dealing with future identification with the work 
force (“What do you hope to be doing five years 
from now?” and “What do you really expect to be 
doing five years from now?’’) and two items indi- 
cating the economic significance of the job (“Are 
you the main wage earner in your household?” 
and “Could your household live adequately if you 
were not working?”). Item responses were dichoto- 
mized and scored “0” (low involvement) or “1” 
(high involvement). Intercorrelations among the 
four items ranged from .38 to .89 

Capacity for job adjustment. Indices of the em- 
ployee’s capacity for adjustment to job changes 
included Personnel Test scores (Wonderlic & Hov- 
land, 1939), years of formal education, and a single 
item job anxiety index. Personnel Test scores were 
available from the personnel files for 181 of the 
232 employees. Job anxiety was indicated by re- 
sponses to the item: “Do things here at work 
ever make you feel ‘jumpy’ or nervous?” (six 
alternatives from “never” to “very often’). 

Supervisory attitudes. The Change Scale was in- 
cluded in the supervisors’ form of the questionnaire, 
together with the Leadership Inventory (Nelson, 
1949) and an abbreviated (11-item) form of the 
Dogmatism Scale (Rokeach, 1956). Scores on these 
three scales served as measures of supervisory atti- 
tudes toward change, toward human relations prac- 
tices, and toward authority, respectively 

The Leadership 
choice items with alternatives 
four idealized patterns of leadership behavior 
(Autocratic, Bureaucratic, Idiocratic, and Demo- 
cratic). Item stems are presented twice, once with 
A and D alternatives, and again with B and I 
alternatives. In the present study, items were com- 
bined into 25 four-choice items. A Human Relations 
score was obtained by summing the number of 
Idiocratic and Democratic alternatives chosen. 

The 11 items for the abbreviated Dogmatism 
(D) Scale were selected on the basis of item 
analysis data presented elsewhere (Rokeach, 1956). 
The D scale was developed by Rokeach (1956) as 
a measure of general authoritarianism. Conceptu- 


consists of 50 two- 


Inventory 
designed to reflect 
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ally, dogmatism is, in part, an attitude toward 
authority. High dogmatic individuals are conceived 
of as being more accepting or rejecting of others 
depending upon whether they agree or disagree 
with their own beliefs. The dogmatic personality 
is at the same time aggressive toward peers and 
subordinates and submissive toward persons in po- 
sitions of authority over him (Trumbo, Rokeach, | 
& Gladin, 1957). Such attitudes toward authority 
and interpersonal relations may be important con- 
ditioners for the behavior and attitudes of the 
subordinates. 

Group cohesiveness. The five-item index of group 
cohesiveness used by (1954) was included 
in the questionnaire. These items were designed to 
measure the extent to which an individual perceives 
himself as belonging to a group, desires to remain 
in the group, and perceives his group to be superior 
to others. 

The predicted relationships were tested by prod- 
uct-moment correlations or by tests of 
between means, depending on the 
available data 


Seashore 


differences 
nature of the 


RESULTS 
Attitudes toward Change and Indices of Job 
Investment 


Data on age, sex, length of service, and 
scores on the JI index were obtained for 
nearly all of the 232 nonsupervisory employ- 
ees. Slight variations in N resulted when 
questionnaire items were omitted or personnel 
records were incomplete. The results are sum- 
marized in Table 1. 

Sex. Change Scale scores were available 
for 47 male and 178 female employees. The 
mean score for men was 31.4 and for women 
27.1. The difference of 4.3 points yielded a 
t value of 3.98 which was significant (p < 
001). 

Age. Information on date of birth was 
recorded for 217 of the 232 employees. On 
the basis of the age distribution, employees 
were grouped into six age level categories. 
A mean Change Scale score was computed 
for each age group. An F test of the differ- 
ences among these means was not significant 
(F = 1.41 with 5/211 df; p> .05). 

Length of service. As indicated in Table 
1, data were available on length of service 
with the company for 209 employees. Be- 
cause of a rather high turnover rate, particu- 
larly among the younger female employees, 
the distribution of length of service was 
highly skewed. Consequently, the distribu- 
tion was dichotomized at the median of 15 





Individual and Group Attitudes to Change 341 


TABLE 1 
SUMMARY OF CORRELATES OF INDIVIDUAI 
CHANGE SCALE SCORES 


months into long- and short-term groups. 
Comparison of the mean Change Scale scores 
for these two groups failed to indicate any 
difference in attitudes toward change (t = 
26). 

Job involvement. The JI index yielded 
five score intervals from 0 to 4. Scores for 
229 employees were essentially rectangularly 
distributed over the five score intervals, 
therefore, to test for relationship, a mean 
Change Scale score was computed for em- 
ployees at each JI score interval. An F test 
of the variance among these means was not 
significant (F = 1.36 with 4/224 df; p> 
.05). The direction of the relationship be- 
tween JI and Change Scale scores was posi- 
tive, however, as indicated by a product- 
moment correlation of .13 (ms). 


Attitudes toward Change and Indices of the 
Capacity of Job Adjustment 


Each of the indices of the employee’s ca- 
pacity for adjustment to changes in the job 
was found to be predictive of change atti- 


tudes. The results are presented in the lower 
portion of Table 1. 

General ability. A product-moment corre- 
lation of .28 between scores on the Wonderlic 
Personnel Test and the Change Scale 
significantly different from zero (with 
dj, p> .001). 


Amount of 


was 
179 
education. Data on years ot 
formal education were obtained for 223 em- 
ployees, who were subsegently grouped at 
four levels of education: less than high school 
(N = 17). high school (N = 126), some 
college (.V 57) and college and graduate 
work (V = 23). An F test of the differences 
among the mean Change Scale scores of these 
four groups yielded a significant F of 6.94 
(with 3/219 df, p< .01). Differences were 
consistent in direction, indicating a positive, 
monotonic relation amount of 
cation and attitudes toward 
mean for the 


edu- 
The 


vroup 
grou} 


between 
change 
and graduate 
(33.8) was significantly different from each 
of the other means, but none of the remaining 
differences was significant. 


college 


Job anxiety. Responses to the single item 
index of job anxiety (“Do things here at 
work ever make you feel ‘jumpy’ or ner- 
vous?”) were distributed as follows: never 
(V¥ = 18), seldom (N = 49), seldom 
(N = 54), sometimes (.V = 91), quite often 
(N = 14), very often (V = 3). Scores were 
assigned serially from 1 to 6 to these re- 
sponse categories. A product-moment correla- 
tion between these scores and Change Scale 
scores yielded a coefficient of — .17 which 
was significantly different from zero (with 
227 df, p< 01). 


very 


Except for differences between men 
the four variables (sex, age, length of 
job involvement) assumed to be indicative of dit 
ferences in the job investment of the 
failed to be related significantly to attitudes toward 
change. Consequently, little support is provided 
for the prediction that the employee with greater job 
investment would have more favorable attitudes to 
ward change. On the other hand, less 
attitudes among the female employees may indicat 
that change is perceived as threatening to 
aspects of the job, which women rate as relatively 
more important than do men (Herzberg, Mausner, 
Peterson, & Capwell, 1957). Support for this in 
terpretation was found in the analysis of situa 
tional factors presented below 

Indices of ability, 


ana womel 


service and 


employe 


favorable 


social 


general amount of education 
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and freedom from job worries were each found to 
be predictive of more favorable attitudes toward 
change. These variables appear to reflect three as- 
pects of the employee’s capacity to adjust to 
changes in his work. The results consistently sup- 
port the prediction that attitudes toward change 
are related to the capacity to adjust to change 
situations. 


Attitudes toward Change in the Work Group 


Of the 232 nonsupervisory employees, 167 
were identified with 21 work groups from 
each of which three or more employees had 
completed the questionnaires. The work 
groups, defined in terms of common first 
level supervision, ranged in size from 3 to 27 
with a median of four members represented 
in the questionnaire data. 

Basic to the decision to study change 
attitudes at the group level was the assump- 
tion that such attitudes are associated with 
group membership. To test this assumption, 
a simple analysis of variance was performed 
on the Change Scale scores of the 21 work 
groups. The resulting F value of 2.64 was 
significant (with 20/146 df, p < .01), indi- 
cating that employees within work groups 
are relatively homogeneous with respect to 
attitudes toward change. A Bartlett’s test of 
homogeneity of variance was not significant 
(x° = 3.77), supporting the conclusion that 
the significant between-group variance was 
indicative of differences among the group 
means. 

These results demonstrate both that change 
attitudes are associated with group member- 
ship and that groups can be meaningfully 
described in terms of attitudes toward 
change. Consequently, Group Change scores 
were computed for the 21 groups as the mean 
of the Change Scale scores of group members. 

Group cohesiveness and group change 
scores. A Cohesiveness score was obtained 
for each of the 21 groups by averaging the 
scores of group members on the five-item 
index. An F test of the between group vari- 
ance yielded an F of 3.91 (with 20/146 df, 
p < .01), confirming Seashore’s (1954) find- 
ing that cohesiveness is a meaningful dimen- 
sion when applied to industrial work groups, 
and supporting the decision to use the mean 
scores as measures of group cohesiveness. 

The predicted negative relationship be- 
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tween Cohesiveness and Group Change scores 
was tested by computing a product-moment 
correlation between the two sets of scores. 
The results, in Table 2, were consistent with 
the prediction. The coefficient of — .50 was 
significantly different from zero (with 20 d/, 
p< .0l). 

Supervisors’ attitudes and group attitudes 
toward change. Results of the correlations 
between three indices of supervisors’ atti- 
tudes and Group Change scores are presented 
in Table 2. 

The Human Relations (HR) scores from 
the Leadership Inventory provided a logically 
valid index of employee-oriented supervisory 
attitudes. Since, as indicated earlier, a social 
climate conducive to group participation and 
decision making appears to reduce overt re- 
sistance to change, it was predicted that HR 
scores would be positively related to Group 
Change scores. The results failed to support 
this prediction, however. The coefficient of .04 
obtained between these two sets of scores was 
obviously not significant. 

The supervisors’ Change Scale scores served 
as the second measure of supervisory atti- 
tudes. Assuming the supervisor’s role as an 
administrator of change to be an important 
conditioner of group change attitudes, a posi- 
tive relationship was expected between Change 
Scale scores of the supervisor and those of 
the group. The coefficient of .41 between these 
two sets of scores supports this prediction 
(with 20 df, p < .05). 


TABLE 2 


SUMMARY OF CORRELATES OF GROUP CHANG 


Scores AND THETR INTERCORRELATIONS 


N = 21 groups) 


Human 
Relations 
score 
(super 
visors) 


Change 
Scale 
(super- 

visors) 


Dogmatisn 


Cohe- (super 


siveness visors 
Change Scale 

(group) - 04 
Change Scale 

(supervisors) 
Cohesiv eness 
Human relations 

score super 
visors) 


*» < .05 (two-tailed test) 


** > < .01 (two-tailed tests) 
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The final measure of supervisors’ attitudes 
was the abbreviated Dogmatism (D) Scale. 
As indicated earlier, a negative relationship 
was predicted between supervisors’ Dogma- 
tism scores and Group Change scores. The re- 
sults are consistent with this prediction. The 
correlation between these two sets of scores 
was — .38, which is significantly different from 
zero (p < .05 with 20 df) 


DISCUSSION 


Failure to find a significant relationship be- 
tween the human relations attitudes of the 
supervisors and group attitudes toward change 
was rather unexpected in view of the popular 
belief about the effectiveness of ‘employee 
oriented” supervision. One explanation of this 
lack of relationship may be found in the re- 
stricted range of human relations attitudes 
among the supervisors. In this connection, it 
was found that the standard deviation of HR 
scores of the 21 supervisors in the group analy- 
sis was considerably, though not significantly, 
less than that of the population of 46 super- 
visors from which they were drawn (¢,2;) = 
6.79, whereas o,4¢) = 11.62). 

Secondly, it is possible that, while human 
relations attitudes of the supervisor condition 
certain attitudes of their subordinates, it 
should not be assumed that they condition all 
work-related attitudes. However, no support 
for this explanation was found. HR scores 
were not significantly related to either group 
cohesiveness scores or summated scores on a 
15-item job satisfaction check list. 

The negative relationship between Cohesive- 
ness and Group Change scores may indicate 
that change is perceived as a source of threat 
to informal group structure and to the satisfac- 
tion of social needs provided for in a cohesive 
work group. This interpretation, which was 
given earlier to account for the less favorable 
attitudes of female workers, appears to be 
supported by both findings. 

A more adequate understanding of the phe- 
nomenology of industrial change requires an 
analysis of employee needs in relationship to 
change attitudes and of the relationship of this 
attitude dimension to other job-related atti- 
tudes. An employee’s response to change is 
probably conditioned by his perception of the 
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way in which the effects of change relate to 
his needs. If change as a general phenomenon 
is to be accepted, its effects must be perceived 
as generally more rewarding than unreward- 
ng, that is, they must provide need satisfac- 
tion. 

What are the effects of change which may 
condition change attitudes? The most obvious 
effect is that change provides variety in the 
job routine. Thus, favorable attitudes toward 
change may reflect a need for variety or 
avoidance of repetition. Change may also en- 
hance the opportunities for promotion thereby 
providing satisfaction for status needs. Fi- 
nally, skill requirements and responsibility de- 
mands may be increased as a result of changs 
thereby providing greater challenge and per- 
haps greater self-expression in one’s work 

These speculations about the need structure 
underlying attitudes toward change gain some 
support from the following evidence: Positive 
relationships were found between Change 
Scale scores and the extent to which employ 
ees liked reported increases in variety, skill 
requirements, responsibility demands, and 
chances for promotion in their work. These 
results suggest that favor 
change because they perceive it as a means 
to greater variety, status, and self-expression 
at work. 

An alternative interpretation would be that 
readiness for change is simply a manifesta- 
tion of job dissatisfaction. That is, an em- 
ployee may welcome change because he is 
dissatisfied with his job in general with 
specific aspects of the job. such as fellow em- 
ployees or supervision. Evidence bearing on 
this interpretation was negative, however. The 
correlation between Change Scale scores and 
summated scores on the 15-item Job Satisfac- 
tion (JS) check list was .07. Furthermore 
upper and lower 27% groups from the Change 
Scale distribution did not differ significantly 
on any of the 15 items of the JS check list. 

In review, the following tentative conclu- 
sions may be presented as hypotheses for 
further research. Employees may perceive 
change as a source of threat to social aspects 
of their job, as indicated both by the less 
favorable attitudes of females and by the 
negative correlation between group cohesive- 
ness and Group Change scores. Situational 


employees may 
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factors, manifested in supervisory attitudes and 
group cohesiveness, appear to be important 
conditioners of change attitudes in the work 
group. Individual differences in attitudes to- 
ward change may reflect differences in the 
capacity to adjust to change situations. Fi- 
nally, readiness for change may be related to 
a complex of needs including variety, status, 
and self-expression at work. 


SUMMARY 


This report presented some of the findings 
of a study of the correlates of employee atti- 
tudes toward change as a general job-related 
phenomenon. Questionnaire and personnel file 
data were obtained for 232 nonsupervisory 
and 46 supervisory personnel of a medium 
sized midwestern insurance company involved 
in office automation. Attitudes toward change 
were measured with a nine-item Change Scale 
included in the questionnaires. Evidence for 
the reliability and logical validity of the 
Scale were presented. 

The results may be summarized as follows: 


1. Female employees scored significantly 
lower on the Change Scale than males. How- 


ever, since none of the other indices of job 
investment (age, length of service, and Job 
Involvement index) was predictive of change 
attitudes, the sex difference was interpreted in 
terms of the differential importance assigned 


to various aspects of the job by men and 
women. Since women consistently rate social 
aspects of the job as relatively more important 
than do men, it was hypothesized that un- 
favorable attitudes toward change may reflect 
a perceived threat to informal social struc- 
ture. 

2. Change Scale scores were positively re- 
lated to Wonderlic Personnel Test scores, 
amount of education, and freedom from job 
anxiety, supporting the view that change at- 
titudes are related to the capacity to adjust 
to changes. 

3. Attitudes toward change were found to 
be associated with work group membership. 
Change Scale scores within groups being rela- 
tively more homogeneous than among groups. 

4. Group cohesiveness was negatively re- 
lated to Group Change scores. This finding 
gave support to the view that less favorable 
attitudes toward change may indicate that 
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change poses a threat to the satisfaction of 
social needs through informal social structure. 

5. Supervisors’ attitudes toward change 
were positively related to Group Change 
scores, while supervisors’ scores on a measure 
of authoritarianism were negatively related to 
Group Change scores. However, supervisors’ 
scores on an index of human relations atti- 
tudes were unrelated to attitudes of the group 
toward change. 

6. Among employees who perceived in- 
creases during the preceding year in variety, 
skill and responsibility demands, and chances 
for promotion, approval of these increases was 
associated with higher Change Scale scores 
than indifference or disapproval. This evidence 
provided tentative support for the view that 
readiness for change is related to employee 
needs for variety, status, and self-expression 
at work. 
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RELIABILITY, SEX DIFFERENCES, AND VALIDITY 
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TECHNIQUE 
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Various technical, predictive, and theoreti- 
cal characteristics of the Leaderless Group 
Discussion (LGD) Technique in military, in- 
dustrial, and college settings have been re- 
ported recently (Bass, 1954; Borg & Tupes, 
1958; Gleason, 1957). The LGD is a minia- 
ture situation which 6 to 10 subjects 
discuss a general problem for approximately 
an hour, at tl 
group 


in 


1e end of which they present a 
solution. The are usually 
judged by trained observers instructed to rate 


subjects 


specified characteristics of leadership emerg- 
ing in the situation, but Gleason (1957) has 
gested an economical procedure in which 
the subjects rate each other. Our study pro- 
vides a comparison of the reliability of three 
LGD judging techniques with analyses of the 
effects of sex composition of the judging, as 


ue 
Su, 


well as of the participant, groups. Personality 
correlates of leadership were examined along 
with the judging behavior of the leaders them- 
selves. 

It would appear almost impossible to meet 
standard conventions of objective testing in 
the LGD where the problem presented to the 
group is intentionally ambiguous, where the 
personal-social composition differs from group 
to group, and where observer instructions vary 
from recording sheer talk to rating general 
and/or specified characteristics of leadership 
(Bass, 1954). Yet, rater reliability estimates 
have approached the limits for any typical 
paper-pencil test, and stability coefficients, 
though more variable, have been satisfactory 
(Bass, 1954). As research has accumulated to 
vield more specifications of conditions of LGD 
administration for objectivity, predictive effi- 
ciency, and economy, the technique has be- 
come increasingly popular among investiga 
tors. Thus, Bass concluded that groups of six 
to eight, whose members are strangers to each 
other, and who discuss case history material 
vield promising (1957) 


results: Gleason’s 
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intersubject rating system dispenses with the 
necessity of trained observers. Consequences 
of these findings lead to logical, provocative 
conceptualizations of the LGD. Demonstrated 
validity and reliability estimates of the LGD 
combined with economical rating techniques 
constituté a good predictor instrument for 
leadership. The LGD remains, however, more 
cumbersome than simple paper-pencil tests 
which can be administered to large groups, but 
it can also be viewed as an intermediate cri- 
terion of leadership with better defined char- 
acteristics than widely used applied criteria. 
More les could be validated 


economical les 
against such a criterion before application to 


sca 
more expensive and complex criteria. 

Specifically the purposes of the present in- 
vestigation were to: (a@) compare the degree 
of LGD judging agreement within and among 
three of ranking defined ob- 
servers, recorders, participants; (+) 
analyze the influence of sex membership of 
the judges and of the participants; (c) evalu- 
ate the accuracy of leader and nonleader rank- 
ings: and (d) examine the relationships be- 
tween LGD leadership and selected factors on 
the Guilford-Zimmerman Temperament Sur- 
vey. 


conditions as 


and 


Ss 


PROCEDURE 
students from 
psychology 


ole 
students in most lab sections was about 


Subjects. Subjects wer 


sections in introductory “he 


number of 


r\ corder 


were assifned to participant and observer o1 
random method 
Participants. Typically t 
each in circular 
rangements at opposite ends of the Grou 
ill and Group B contained mixed 
males and females. In a fe the 
smaller lab sections there was only LGD group 
Participants wore identifying tags, numbered from 
one to six. Ther 19 Group A 
and 19 Group B arrangements 
participants 

Observers and Recorder 
by two pairs of nonparticipating students seated on 


roles by a 
LGD 
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rys ot 


wo gt 
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Using bridge terminology, 


“ 


the periphery of the circle 
North and South were designated 
East and West, each of the two pairs 
consisted of a female. Recorders were 
provided with appropriate tabulation sheets to check 
every incidence of talking by each member of the 
LGD group. Observers were instructed to fill out a 
five-point rating form employed in the Bass studies 
(Bass & Norton, 1951) at the end of the observa- 
tion period. This rating scale contains 18 items in- 
volving behavior, influencing others, 
consideration for others, and authoritativeness. Ob- 
servers and recorders, 7¢ 
selected from their lab sections. 

Task Presentation. The LGD groups listened to a 
short, 2-minute tape recording of a playlet concern- 
ing a coed’s indecision remaining in 
There was no obvious, pat solution. The participants 
in each discussed the 
minutes, and then each participant wrote a solution 
They next ranked member on leadership, as 
did the observers and recorders, according to the 
following instructions 


observers” ; 
“recorders” ; 


male and a 


initiation of 


males and 76 females, were 


about college 


group coed’s problem 20 


each 


Place the number of the discussant who in your 
opinion was the leader of the opposite 
Number 1; then list opposite Number 6 the num 
ber of the person who was lowest in leadership 
Then opposite Number 2 list the number of the 
discussant next highest in leadership; opposite 5, 
the number of the person second lowest in leader 
ship. Continue until all people have been ranked 


group 


It should be noted that three independent leader- 
ship rankings available from 
corders, and participants.. The experimental design 
provided data relevant to sex differences in judging 
LGD behavior, 
ship first five Guilford 
Zimmerman Temperament administered 1 
weeks prior to the LGD experiment, were availabl 
on most 
lates. 


were observers, re- 


is well as in the emergence of leader 


Scores on the scales of th 


Survey, 


subjects for analysis of personality corre 
RESULTS 


Reliability 


The measures of reli ibility emploved in this 
study might be classified the “degree of agree- 
ment” among judges, with analyses including 
the effects of the sex of the judges, the sex 
of the LGD participants, and the ranking con- 
dition. Two of the ranking conditions, observ 
ing and recording, were relatively passive in 
contrast to active LGD participation which 
led to a type of sociometric evaluation 

Within ( onditions of Rank ing Che degree 
of agreement was computed between observer 


pairs, between recorder pairs, and among par- 
ticipants. Spearman’s rho coefficient was used 
to express agreement between each of the 38 
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observer, and between each of the 38 recorder, 
pairs. Kendall’s coefficient of concordance, W, 
was particularly appropriate to express the 
degree of agreement among the six partici- 
pants in each LGD group since it constitutes 
the mean of all possible rho correlations; thus, 
the unit of agreement was essentially the same 
for all types of observation. Table 1 presents 
rho and W coefficients in quartile values for 
the observer, recorder, and participant groups; 
the range of the median coefficients is .67—.92 
If, as is usually the case, the ratings were 
pooled over a condition of ranking or evalua- 
tion, the reliabilities of the sums would be 
considerably higher; this would be particu- 
larly apparent for the participant sums which 
would be based on six rankings. These con- 
servative reliability estimates, then, 
substantial, and they are comparable over 
ranking as demonstrated in 
Table 1, and as analyzed below. 

Between Conditions of Ranking. After find- 
ing the high agreement within ranking condi- 
tions, it was important to determine the extent 
of agreement among the ranking conditions 
in order to obtain further clarification on 
which, if any, might be the most adequate 
measure of LGD performance. The three con- 
ditions of assessment represented by observer, 
recorder, and participant rankings, respec- 
tively, were compared. For each LGD group 
of six, the two observer rankings were pooled, 


appear 


conditions of 


the two recorder rankings were pooled, and 
the six participant rankings were pooled. Rho 


TABLE 1 
VALUES 
RELIABILITIES 


QUARTILE FOR RHO AND 


Raters 


Groups Rate 
Observers Recorder 


rho rho 
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TABLE 2 


MEDIAN RHO VALUES BETWEEN CONDITIONS O1 


Group A 


Condition Combinations 


Observer-Recorder 
Observer- Participant 
Recorder- Participant 


correlations were then computed for the 38 
groups between all combinations of the three 
conditions; these results are summarized in 
the median coefficients presented in Table 2. 
The magnitudes of these median intercorrela- 
tions, ranging from .84 to .94, suggest that 
within a given LGD group the three condi 
tions of ranking yield comparable results. 
These findings, moreover, verify the substan- 
tial reliability of the LGD technique as 
employed in our study. The base measures 
used in our subsequent analyses were the 
pooled participant composite rankings be- 
cause: (a) they can be easily and economi- 
cally obtained in an LGD situation, (0) 
they are based upon rankings by the largest 
number of judges, and (c) of the convenient 
tautology that the leader selected by the 
participants is by one definition the leader 
of the group. 

Interactions between Sex and Conditions of 
Ranking. In this analysis of variance, having 
selected the pooled participant composite as 
our criterion measure, we considered: (a) 
two social conditions (19 same sex and 19 
mixed sex LGD groups of six each), (6) two 
types of observation (the remaining two con- 
ditions of ranking by observers and record- 
ers), and (c) sex within the conditions of 
observation (one male and one female ob- 
server, one male and one female recorder in 
each of 38 groups). Using our criterion meas- 
ure we examined accuracy of observation as a 
function of ranking condition, sex of the ob- 
server, and interaction with the sex composi- 
tion of the LGD group. The sum of the differ- 
ences squared between the criterion and the 
rankings of an_ individual 
corder was the unit of measurement for each 


observer or re 


social condition in a double analysis of vari- 
ance. The two main effects, 
servation 


conditions of ob 


and sex of the observer, did not 


19 same sex sextets 


t 


yield significance, nor did the interactions 
with social composition. The findings did not 
support expectations based on our research in 
social intelligence (Witryol & Kaess, 1957) 
that females would be more perceptive of 
cial behavior. 


Accuracy of Leader and Nonleader Judgment 


1 


The accuracy of the leader’s perception of 
the group as a significant requisite has been 
treated in a contradictory fashion in the re- 
search literature. Those investigators who deal 
with an empathy construct in leadership have 
emphasized social insight and perceptual ac- 
curacy, while other workers have found that 
personal characteristics like dominance and 
egocentricism, which may blunt accurate so- 
cial perception, are more relevant features 
Our data provided a these 
incompatible positions. 

On the 


modest test of 


sum of 
highest in leader- 
ship were compared in social accuracy with 


basis of the partic ipant 
scores received, those ranked 


those ranked lowest in each group. The cri- 
terion of group structure was defined by the 
rankings assigned via the pooled participant 
composite, the base measure indicated above 
Social accuracy was then determined by the 
amount of agreement between an individual’s 
judgments and the pooled composite. The 
sum of the differences squared between judg- 
ments by an individual of high or low leader- 
ship and the pooled composite judgments was 
the specific measure for expressing social ac 
curacy of leaders and nonleaders. 

From the analysis of variance in Table 3 
it was inferred that nonleader judgments were 
more congruent with the criterion than were 
leader judgments at a high statistical 

In Group A 
judgments cor- 


very 


} 


confidence level, beyond .001 


the median rho for nonleade1 
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rABLE 3 


VARIANCE BY 
LGD Group CONDITIONS 


ANALYSIS OI LEADERSHIP AND 


Conditions 


882.6 
99.6 
165.6 
4848.0 


Leaders-Nonleaders 
LGD Groups 
Interaction 

Within Groups 


001 levei 


related with the pooled composite was .89; 
for leaders, .79; in Group B the rho’s were 
.91 and .60, respectively (NV = 19 in both 
groups). Perceptual accuracy of leadership 
did not yield statistical significance as a 
function of group conditions, nor were the 
interactions significant. In short, nonleaders 
were more accurate in perceiving LGD leader- 
ship status. Further analyses which we shall 
not report in detail here support this general 
finding. Thus, the leader was as likely to 
disagree with the composite in judging non- 
leaders, as in identifying leaders, reflecting 
lack of congruence with the criterion in vari- 
ous portions of the judging scale. Finally, 
leader judgments were in less agreement than 
nonleader ratings when both groups were com- 
pared with the observer and recorder com- 
posites. 


Personality of LGD Leaders 


The first five scales of the Guilford-Zim- 
merman Temperament Survey, administered 
10 weeks the present investigation, 
were available on about 70% of the subjects. 
In Group A (male sextets) 26 leaders, defined 
as Ranks 1 and 2 on the pooled composite 
criterion and 27 nonleaders, defined as Ranks 
5 and 6, were compared on the GZ scale. 
Leaders were higher than nonleaders on 
General Activity (G), Ascendance (A), and 
Sociability (S) at .05, .01, and .05 confidence 
levels, respectively, as demonstrated in Table 
4. A discriminant function equation com- 
puted for Group A took the raw score form: 


before 


D= 838 G+ 1.858 A+ .348 § 
The F of this discriminant function is 28.22 
for df = 3/46; the .01 confidence level, 6.60. 


The mean discriminant scores for leaders and 
nonleaders were 53.93 and 41.74, respectively. 
Maximum accuracy of leadership classification 
would follow, then, from a D score of 47.84 
and above. 

When the discriminant equation was ap- 
plied to males in Group B (mixed sex sextets) , 
seven of nine leaders and 12 of 17 nonleaders 
were correctly classified. The chi square of 
5.54, significant at the .02 level, suggests that 
leadership personality characteristics for males 
in one type of LGD group (same sex) are 
similar in the other type (mixed sex). This 
is further supported by an r of .45 between 
D scores and the pooled composite leadership 
scores for 34 males in Group B. 

The discriminant function did not predict 
female leadership in the mixed sex LGD 
groups, nor were scores on the five GZ scales 
suggestive of leadership-nonleadership differ- 
ences. Personality characteristics appropriate 
to male leadership do not appear to be the 
those in female leaders, in mixed 
groups, the only ones available for the female 
analysis. The sex distributions over the six 
ranks may provide some clues. The polar 
Ranks 1, 5, and 6 were dominated by males: 
67%, 69%, and 61%, respectively; the inter 
mediate Ranks 2, 3, and 4 were dominated by 
females: 70%, 58 and 70%, respectively. 
Females appear to exercise more subtle, if 
secondary, leadership when the sexes are 
mixed. Those who actively competed for the 
first position with males fall outside the con- 
ventional pattern. Obviously personality char- 
acteristics of females in a mixed sex situation 


Same as 


rABLE 4 


LEADER AND NONLEADER GUILFORD-ZIMMERMAN 


SCORES FOR MALE Group 


Activit 18.00 6.3 
14.92 4 
17.32 4 
19.36 6.2 
16.35 5.40 


14.12 5.81 
15.07 5.40 


13.28 5.53 


General 

Restraint 
Asce ndan e€ 
Sociability 15.20 6.95 


Emotional Stability 16.63 5.20 
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are more complex in association with leader- 
ship under these circumstances. 


DISCUSSION 


1 


Our reliability findings are high and con- 
gruent with those reported in the definitive 
LGD review 1954). We have 
demonstrated substantial agreement among 
participants when they rank their own peers 
within a group, an analysis not previously 


( Bass, also 


found in the literature, and we have compared 
rankings with two different external 
rating observations of LGD leadership. The 
strong within and among these 
various conditions of observation are impres- 
when 
social possibilities inherent in 38 six-member 


these 
agreement 


sive one considers the heterogeneous 
groups where the members were more or less 
strangers to each other and where 19 of the 
groups contained male and female subjects. 
take command 


and be subsequently dethroned, in another 


In one group a leader might 


no one had much to say, and in a third every- 
talked at the same time. 
observations 


one These casual 


confirmed and 
tematized in a small group study employing 
Bale’s categories (Kirscht, Lodahl, & Haire, 
1959) from which the investigators concluded 


have been sys- 


that the leader is the one who has ideas where 
they are lacking, or that the leader has ideas 
that are integrative and task relevant when 
talk abounds. Our findings strongly retlect the 
accuracy of LGD leadership determination 
despite the variability of group composition, 
situational demands, and the special require- 
ments of leadership. 

We are tempted to speculate about an 
hypothetical predisposition toward leadership 
which takes many forms as a function of social 
situations. The LGD technique yields a globa 


approach to leadership comparable to Binet’s 
success in the 


measurement of intelligence 
where Cattell’s atomism failed. Carrying this 
analogy one step further, the personal corre 
lates of small group leadership so frequently 
studied may be similar to the implications, 
with varying degrees of success, of factor 
intellectual and 
theory. And in both situational 


approach too often leads to a frustrating in- 


analysis fot measurement 


areas the 


l 


finite regress. None of these approaches need 


be abandoned; reviews of the literature on 
small groups have pointed up the 
possibilities 1954; Mann, 
Global judgments of observers, however, and 
particularly of participants may uncover per- 
sonality characteristics underlying leadership 
in a wider variety of 


multiple 


( Bass, 1959). 


social situations; flexi- 
bility of behavior required for leadership un- 
der diverse circumstances may not be discov- 
ered if emphasis is placed upon the minutiae 
of action. 

The personality correlates of male LGD 
leadership identified in our investigation (gen- 
eral activity, ascendance, and sociability or 
“GAS”) suggest an intriguing research defi- 
nition of the issues raised. The GZ factors of 
ascendance and sociability for small group 
leadership have been cited in the two perti- 
nent reviews by Mann; 
factors have also been confirmed with projec- 
tive material (Mussen & Porter, 1959) 
cited these correlates in 


Bass and DS these 
Bass 
lemaie groups, We 
were unable to replicate for our females in 
mixed sex groups, but we did get replication 
for males in both 


groupings. The evidence reflects the signili- 


Same sex and mixed sex 


cance of these personality factors for males 
in a wide variety of LGD situations. The en 
ergetic, ascendant, sociable male is likely to be 
a leader among both men and women in the 
most global sense. The failure to replicate 
for females in mixed sex groupings is ascribed 
to cultural role expectations, but the 
factors “work,” according to the litera 
for female leaders in female groups. 

If we can assume that the elusive concept 
of interpersonal sensitivity was to 


tent 


some e€xX- 
reflected in our analysis of leader and 
nonleader judging accuracy, and if LGD lead 
ership represents important dimensions, the 
implications for research direction are fairly 
clear. Our leaders were inferior to the non 
leaders in their accuracy of ranking both lead- 
ers and nonleaders in LGD groups, based on 
our sociometric and external ranking criteria. 
Our results support a qualified endorsement of 
the relevance of certain strong personality 
traits demonstrated in another LGD study 
(Borg & Tupes, 1958) where rated character- 
istics such as extroversion, assertiveness, and 


energy were related to leadership. Mann’s 


review (1959) of 500 personality studies in- 
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volving small group behavior tends to support 
this position, and he pointed out difficulties 
in dealing with such constructs as empathy 
and interpersonal sensitivity. It may well be, 
on the other hand, that personality trait cor- 
relates of leadership are a function of the 
greater popularity of this research approach 
among psychologists, leading to an exagger- 
ated emphasis as a consequence of the sheer 
number of investigations. 

To conclude, certain requirements of 
economy and standardization of LGD pro- 
cedures were urged by Bass (1954). Gleason 
(1957) reduced the need for trained observers 
by “buddy” ratings, and we have reduced 
discussion time to 20 minutes and demon- 
strated substantial reliability for male and 
mixed sex groups. Other investigators have 
employed brief discussion periods without re- 
porting reliability (Borg & Tupes, 1958; 
Kirscht et al., 1959; Mussen & Porter, 1959). 
We recommend the LGD as a relatively well 
standardized prototype of group behavior with 
strong possibilities of general predictive effi- 
ciency. Assuming the latter we are impressed 
with the potential utility of the LGD as a 
stable intermediate criterion against which to 
assess more economical pencil-paper measures 
of leadership. The LGD may well represent 
a model paradigm for getting a criterion to 
stay put in a complex area of measurement. 


SUMMARY 


Three Leaderless Group Discussion judging 
techniques involving leadership rankings by 
observers, recorders, and participants were 
applied to 228 college subjects arranged in 
19 all male and 19 mixed sex groups of six 
each. Judging-agreement within and among 
ranking conditions was high, despite the fact 
that judges in all conditions were 380 un- 
trained college observers; the sex of those 
rated and those being rated did not appear 
to affect ranking accuracy. 

When evaluated against a pooled com- 
posite ranking criterion of participant judg- 
ments, a form of sociometric assessment, LGD 
leaders were inferior to nonleaders in their 
social accuracy of judging LGD leadership. 
Although leaders failed in interpersonal sensi- 
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tivity as measured by the criterion above, the 
males were characterized by ““GAS’”—General 
Activity, Ascendance, and Sociability factor 
correlates from the Guilford-Zimmerman Tem- 
perament Survey; these relationships are con- 
sistent with published evidence reviewed by 
Bass (1954) and Mann (1959). A GAS 
discriminant function failed to replicate for 
female leaders whose LGD positions were 
available for analysis in mixed sex groups 
only, but the function was applicable to male 
leaders in same sex and mixed sex groups 
The Bass review has indicated similar per- 
sonality traits for female leaders in same 
sex LGD groups. 

Our findings taken together with published 
evidence suggest a reliable and economical 
approach to LGD leadership assessment under 
complex social circumstances. The definition 
by personality correlates of the characteris- 
tics of LGD leadership, demonstrated in re 
search, leads us to recommend this small 
group approach not only as a useful pre- 
dictor, but also as a fruitful intermediate 
criterion for evaluating other research ap- 
proaches to leadership. 
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